{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "05- Neuron Factors.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "authorship_tag": "ABX9TyM3g0GHWeQGHxRkn4PodvXC",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/jalammar/ecco/blob/main/notebooks/Ecco_Neuron_Factors-BERT.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "CLDsAru2N0lr"
      },
      "source": [
        "!pip install ecco"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "sknc5dj3N1LS"
      },
      "source": [
        "import ecco\n",
        "# Other options are: 'distilbert-base-uncased' and 'bert-large-uncased'\n",
        "lm = ecco.from_pretrained('bert-base-uncased', activations=True)"
      ],
      "execution_count": 54,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "CO4Q942SN2wM"
      },
      "source": [
        "text = ''' Now I ask you: what can be expected of man since he is a being endowed with strange qualities? Shower upon him every earthly blessing, drown him in a sea of happiness, so that nothing but bubbles of bliss can be seen on the surface; give him economic prosperity, such that he should have nothing else to do but sleep, eat cakes and busy himself with the continuation of his species, and even then out of sheer ingratitude, sheer spite, man would play you some nasty trick. He would even risk his cakes and would deliberately desire the most fatal rubbish, the most uneconomical absurdity, simply to introduce into all this positive good sense his fatal fantastic element. It is just his fantastic dreams, his vulgar folly that he will desire to retain, simply in order to prove to himself--as though that were so necessary-- that men still are men and not the keys of a piano, which the laws of nature threaten to control so completely that soon one will be able to desire nothing but by the calendar. And that is not all: even if man really were nothing but a piano-key, even if this were proved to him by natural science and mathematics, even then he would not become reasonable, but would purposely do something perverse out of simple ingratitude, simply to gain his point. And if he does not find means he will contrive destruction and chaos, will contrive sufferings of all sorts, only to gain his point! He will launch a curse upon the world, and as only man can curse (it is his privilege, the primary distinction between him and other animals), may be by his curse alone he will attain his object--that is, convince himself that he is a man and not a piano-key!\n",
        "'''\n",
        "\n",
        "inputs = lm.tokenizer([text], return_tensors=\"pt\")\n",
        "output = lm(inputs)"
      ],
      "execution_count": 55,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "l171rfDeBff-"
      },
      "source": [
        "# Factorize activations in all the layers\n",
        "nmf_1 = output.run_nmf(n_components=8) "
      ],
      "execution_count": 57,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "8IKtaOA5B0XG",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 394
        },
        "outputId": "d6b59af0-41c3-49a2-f86f-36d869ebdaf2"
      },
      "source": [
        "nmf_1.explore()"
      ],
      "execution_count": 58,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<html lang=\"en\">\n",
              "<script src=\"https://requirejs.org/docs/release/2.3.6/minified/require.js\"></script>\n",
              "<script>\n",
              "    var ecco_url = 'https://storage.googleapis.com/ml-intro/ecco/'\n",
              "    // var ecco_url = 'http://localhost:8000/ecco/'\n",
              "\n",
              "    if (window.ecco === undefined) window.ecco = {}\n",
              "\n",
              "    requirejs.config({\n",
              "        urlArgs: \"bust=\" + (new Date()).getTime(),\n",
              "        nodeRequire: require,\n",
              "        paths: {\n",
              "            d3: \"https://d3js.org/d3.v5.min\",\n",
              "            \"d3-array\": \"https://d3js.org/d3-array.v2.min\",\n",
              "            jquery: \"https://code.jquery.com/jquery-3.5.1.min\",\n",
              "            // oldEcco: ecco_url + 'ecco',\n",
              "            ecco: ecco_url + 'js/0.0.4/ecco-bundle.min',\n",
              "            xregexp: 'https://cdnjs.cloudflare.com/ajax/libs/xregexp/3.2.0/xregexp-all.min'\n",
              "        }\n",
              "    });\n",
              "    requirejs(['d3'],\n",
              "        function (d3) {\n",
              "            d3.select('#css').attr('href', ecco_url + 'html/styles.css')\n",
              "        })\n",
              "\n",
              "    console.log('Ecco initialize.')\n",
              "</script>\n",
              "\n",
              "<head>\n",
              "    <link id='css' rel=\"stylesheet\" type=\"text/css\">\n",
              "</head>\n"
            ],
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ]
          },
          "metadata": {
            "tags": []
          }
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<script>\n",
              "    // console.log('defining basic')\n",
              "    define('basic', ['d3'],\n",
              "        function (d3) {\n",
              "            return {\n",
              "                init: function (viz_id = null) {\n",
              "\n",
              "                    // console.log('basic init')\n",
              "                    if (viz_id == null){\n",
              "                        viz_id = \"viz_\" + Math.round(Math.random() * 10000000)\n",
              "                    }\n",
              "                    const div = d3.select('#basic').attr('id', viz_id),\n",
              "                        div_parent = d3.select('#' + viz_id).node().parentNode\n",
              "\n",
              "                    // Link to CSS file\n",
              "                    d3.select(div_parent).insert('link')\n",
              "                        .attr('rel', 'stylesheet')\n",
              "                        .attr('type', 'text/css')\n",
              "                        .attr('href', ecco_url + 'html/styles.css')\n",
              "\n",
              "                    return viz_id\n",
              "                }\n",
              "            }\n",
              "        }, function (err) {console.log(err);}\n",
              "    )\n",
              "    // console.log('after defining basic')\n",
              "\n",
              "</script>\n",
              "<div id=\"basic\"></div>\n"
            ],
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ]
          },
          "metadata": {
            "tags": []
          }
        },
        {
          "output_type": "display_data",
          "data": {
            "application/javascript": [
              "\n",
              "         requirejs(['basic', 'ecco'], function(basic, ecco){\n",
              "            const viz_id = basic.init()\n",
              "            ecco.interactiveTokensAndFactorSparklines(viz_id, {'tokens': [{'token': '[CLS]', 'token_id': 101, 'type': 'input', 'position': 0}, {'token': 'now', 'token_id': 2085, 'type': 'input', 'position': 1}, {'token': 'i', 'token_id': 1045, 'type': 'input', 'position': 2}, {'token': 'ask', 'token_id': 3198, 'type': 'input', 'position': 3}, {'token': 'you', 'token_id': 2017, 'type': 'input', 'position': 4}, {'token': ':', 'token_id': 1024, 'type': 'input', 'position': 5}, {'token': 'what', 'token_id': 2054, 'type': 'input', 'position': 6}, {'token': 'can', 'token_id': 2064, 'type': 'input', 'position': 7}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 8}, {'token': 'expected', 'token_id': 3517, 'type': 'input', 'position': 9}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 10}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 11}, {'token': 'since', 'token_id': 2144, 'type': 'input', 'position': 12}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 13}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 14}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 15}, {'token': 'being', 'token_id': 2108, 'type': 'input', 'position': 16}, {'token': 'endowed', 'token_id': 19038, 'type': 'input', 'position': 17}, {'token': 'with', 'token_id': 2007, 'type': 'input', 'position': 18}, {'token': 'strange', 'token_id': 4326, 'type': 'input', 'position': 19}, {'token': 'qualities', 'token_id': 11647, 'type': 'input', 'position': 20}, {'token': '?', 'token_id': 1029, 'type': 'input', 'position': 21}, {'token': 'shower', 'token_id': 6457, 'type': 'input', 'position': 22}, {'token': 'upon', 'token_id': 2588, 'type': 'input', 'position': 23}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 24}, {'token': 'every', 'token_id': 2296, 'type': 'input', 'position': 25}, {'token': 'earthly', 'token_id': 29520, 'type': 'input', 'position': 26}, {'token': 'blessing', 'token_id': 13301, 'type': 'input', 'position': 27}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 28}, {'token': 'drown', 'token_id': 19549, 'type': 'input', 'position': 29}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 30}, {'token': 'in', 'token_id': 1999, 'type': 'input', 'position': 31}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 32}, {'token': 'sea', 'token_id': 2712, 'type': 'input', 'position': 33}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 34}, {'token': 'happiness', 'token_id': 8404, 'type': 'input', 'position': 35}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 36}, {'token': 'so', 'token_id': 2061, 'type': 'input', 'position': 37}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 38}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 39}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 40}, {'token': 'bubbles', 'token_id': 17255, 'type': 'input', 'position': 41}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 42}, {'token': 'bliss', 'token_id': 13670, 'type': 'input', 'position': 43}, {'token': 'can', 'token_id': 2064, 'type': 'input', 'position': 44}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 45}, {'token': 'seen', 'token_id': 2464, 'type': 'input', 'position': 46}, {'token': 'on', 'token_id': 2006, 'type': 'input', 'position': 47}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 48}, {'token': 'surface', 'token_id': 3302, 'type': 'input', 'position': 49}, {'token': ';', 'token_id': 1025, 'type': 'input', 'position': 50}, {'token': 'give', 'token_id': 2507, 'type': 'input', 'position': 51}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 52}, {'token': 'economic', 'token_id': 3171, 'type': 'input', 'position': 53}, {'token': 'prosperity', 'token_id': 14165, 'type': 'input', 'position': 54}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 55}, {'token': 'such', 'token_id': 2107, 'type': 'input', 'position': 56}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 57}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 58}, {'token': 'should', 'token_id': 2323, 'type': 'input', 'position': 59}, {'token': 'have', 'token_id': 2031, 'type': 'input', 'position': 60}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 61}, {'token': 'else', 'token_id': 2842, 'type': 'input', 'position': 62}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 63}, {'token': 'do', 'token_id': 2079, 'type': 'input', 'position': 64}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 65}, {'token': 'sleep', 'token_id': 3637, 'type': 'input', 'position': 66}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 67}, {'token': 'eat', 'token_id': 4521, 'type': 'input', 'position': 68}, {'token': 'cakes', 'token_id': 22619, 'type': 'input', 'position': 69}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 70}, {'token': 'busy', 'token_id': 5697, 'type': 'input', 'position': 71}, {'token': 'himself', 'token_id': 2370, 'type': 'input', 'position': 72}, {'token': 'with', 'token_id': 2007, 'type': 'input', 'position': 73}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 74}, {'token': 'continuation', 'token_id': 13633, 'type': 'input', 'position': 75}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 76}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 77}, {'token': 'species', 'token_id': 2427, 'type': 'input', 'position': 78}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 79}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 80}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 81}, {'token': 'then', 'token_id': 2059, 'type': 'input', 'position': 82}, {'token': 'out', 'token_id': 2041, 'type': 'input', 'position': 83}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 84}, {'token': 'sheer', 'token_id': 11591, 'type': 'input', 'position': 85}, {'token': 'ing', 'token_id': 13749, 'type': 'input', 'position': 86}, {'token': '##rat', 'token_id': 8609, 'type': 'input', 'position': 87}, {'token': '##itude', 'token_id': 18679, 'type': 'input', 'position': 88}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 89}, {'token': 'sheer', 'token_id': 11591, 'type': 'input', 'position': 90}, {'token': 'spite', 'token_id': 8741, 'type': 'input', 'position': 91}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 92}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 93}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 94}, {'token': 'play', 'token_id': 2377, 'type': 'input', 'position': 95}, {'token': 'you', 'token_id': 2017, 'type': 'input', 'position': 96}, {'token': 'some', 'token_id': 2070, 'type': 'input', 'position': 97}, {'token': 'nasty', 'token_id': 11808, 'type': 'input', 'position': 98}, {'token': 'trick', 'token_id': 7577, 'type': 'input', 'position': 99}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 100}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 101}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 102}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 103}, {'token': 'risk', 'token_id': 3891, 'type': 'input', 'position': 104}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 105}, {'token': 'cakes', 'token_id': 22619, 'type': 'input', 'position': 106}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 107}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 108}, {'token': 'deliberately', 'token_id': 9969, 'type': 'input', 'position': 109}, {'token': 'desire', 'token_id': 4792, 'type': 'input', 'position': 110}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 111}, {'token': 'most', 'token_id': 2087, 'type': 'input', 'position': 112}, {'token': 'fatal', 'token_id': 10611, 'type': 'input', 'position': 113}, {'token': 'rubbish', 'token_id': 29132, 'type': 'input', 'position': 114}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 115}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 116}, {'token': 'most', 'token_id': 2087, 'type': 'input', 'position': 117}, {'token': 'une', 'token_id': 16655, 'type': 'input', 'position': 118}, {'token': '##con', 'token_id': 8663, 'type': 'input', 'position': 119}, {'token': '##omic', 'token_id': 22026, 'type': 'input', 'position': 120}, {'token': '##al', 'token_id': 2389, 'type': 'input', 'position': 121}, {'token': 'absurd', 'token_id': 18691, 'type': 'input', 'position': 122}, {'token': '##ity', 'token_id': 3012, 'type': 'input', 'position': 123}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 124}, {'token': 'simply', 'token_id': 3432, 'type': 'input', 'position': 125}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 126}, {'token': 'introduce', 'token_id': 8970, 'type': 'input', 'position': 127}, {'token': 'into', 'token_id': 2046, 'type': 'input', 'position': 128}, {'token': 'all', 'token_id': 2035, 'type': 'input', 'position': 129}, {'token': 'this', 'token_id': 2023, 'type': 'input', 'position': 130}, {'token': 'positive', 'token_id': 3893, 'type': 'input', 'position': 131}, {'token': 'good', 'token_id': 2204, 'type': 'input', 'position': 132}, {'token': 'sense', 'token_id': 3168, 'type': 'input', 'position': 133}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 134}, {'token': 'fatal', 'token_id': 10611, 'type': 'input', 'position': 135}, {'token': 'fantastic', 'token_id': 10392, 'type': 'input', 'position': 136}, {'token': 'element', 'token_id': 5783, 'type': 'input', 'position': 137}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 138}, {'token': 'it', 'token_id': 2009, 'type': 'input', 'position': 139}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 140}, {'token': 'just', 'token_id': 2074, 'type': 'input', 'position': 141}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 142}, {'token': 'fantastic', 'token_id': 10392, 'type': 'input', 'position': 143}, {'token': 'dreams', 'token_id': 5544, 'type': 'input', 'position': 144}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 145}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 146}, {'token': 'vulgar', 'token_id': 29364, 'type': 'input', 'position': 147}, {'token': 'folly', 'token_id': 26272, 'type': 'input', 'position': 148}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 149}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 150}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 151}, {'token': 'desire', 'token_id': 4792, 'type': 'input', 'position': 152}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 153}, {'token': 'retain', 'token_id': 9279, 'type': 'input', 'position': 154}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 155}, {'token': 'simply', 'token_id': 3432, 'type': 'input', 'position': 156}, {'token': 'in', 'token_id': 1999, 'type': 'input', 'position': 157}, {'token': 'order', 'token_id': 2344, 'type': 'input', 'position': 158}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 159}, {'token': 'prove', 'token_id': 6011, 'type': 'input', 'position': 160}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 161}, {'token': 'himself', 'token_id': 2370, 'type': 'input', 'position': 162}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 163}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 164}, {'token': 'as', 'token_id': 2004, 'type': 'input', 'position': 165}, {'token': 'though', 'token_id': 2295, 'type': 'input', 'position': 166}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 167}, {'token': 'were', 'token_id': 2020, 'type': 'input', 'position': 168}, {'token': 'so', 'token_id': 2061, 'type': 'input', 'position': 169}, {'token': 'necessary', 'token_id': 4072, 'type': 'input', 'position': 170}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 171}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 172}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 173}, {'token': 'men', 'token_id': 2273, 'type': 'input', 'position': 174}, {'token': 'still', 'token_id': 2145, 'type': 'input', 'position': 175}, {'token': 'are', 'token_id': 2024, 'type': 'input', 'position': 176}, {'token': 'men', 'token_id': 2273, 'type': 'input', 'position': 177}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 178}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 179}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 180}, {'token': 'keys', 'token_id': 6309, 'type': 'input', 'position': 181}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 182}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 183}, {'token': 'piano', 'token_id': 3682, 'type': 'input', 'position': 184}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 185}, {'token': 'which', 'token_id': 2029, 'type': 'input', 'position': 186}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 187}, {'token': 'laws', 'token_id': 4277, 'type': 'input', 'position': 188}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 189}, {'token': 'nature', 'token_id': 3267, 'type': 'input', 'position': 190}, {'token': 'threaten', 'token_id': 15686, 'type': 'input', 'position': 191}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 192}, {'token': 'control', 'token_id': 2491, 'type': 'input', 'position': 193}, {'token': 'so', 'token_id': 2061, 'type': 'input', 'position': 194}, {'token': 'completely', 'token_id': 3294, 'type': 'input', 'position': 195}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 196}, {'token': 'soon', 'token_id': 2574, 'type': 'input', 'position': 197}, {'token': 'one', 'token_id': 2028, 'type': 'input', 'position': 198}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 199}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 200}, {'token': 'able', 'token_id': 2583, 'type': 'input', 'position': 201}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 202}, {'token': 'desire', 'token_id': 4792, 'type': 'input', 'position': 203}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 204}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 205}, {'token': 'by', 'token_id': 2011, 'type': 'input', 'position': 206}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 207}, {'token': 'calendar', 'token_id': 8094, 'type': 'input', 'position': 208}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 209}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 210}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 211}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 212}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 213}, {'token': 'all', 'token_id': 2035, 'type': 'input', 'position': 214}, {'token': ':', 'token_id': 1024, 'type': 'input', 'position': 215}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 216}, {'token': 'if', 'token_id': 2065, 'type': 'input', 'position': 217}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 218}, {'token': 'really', 'token_id': 2428, 'type': 'input', 'position': 219}, {'token': 'were', 'token_id': 2020, 'type': 'input', 'position': 220}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 221}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 222}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 223}, {'token': 'piano', 'token_id': 3682, 'type': 'input', 'position': 224}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 225}, {'token': 'key', 'token_id': 3145, 'type': 'input', 'position': 226}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 227}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 228}, {'token': 'if', 'token_id': 2065, 'type': 'input', 'position': 229}, {'token': 'this', 'token_id': 2023, 'type': 'input', 'position': 230}, {'token': 'were', 'token_id': 2020, 'type': 'input', 'position': 231}, {'token': 'proved', 'token_id': 4928, 'type': 'input', 'position': 232}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 233}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 234}, {'token': 'by', 'token_id': 2011, 'type': 'input', 'position': 235}, {'token': 'natural', 'token_id': 3019, 'type': 'input', 'position': 236}, {'token': 'science', 'token_id': 2671, 'type': 'input', 'position': 237}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 238}, {'token': 'mathematics', 'token_id': 5597, 'type': 'input', 'position': 239}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 240}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 241}, {'token': 'then', 'token_id': 2059, 'type': 'input', 'position': 242}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 243}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 244}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 245}, {'token': 'become', 'token_id': 2468, 'type': 'input', 'position': 246}, {'token': 'reasonable', 'token_id': 9608, 'type': 'input', 'position': 247}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 248}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 249}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 250}, {'token': 'purposely', 'token_id': 24680, 'type': 'input', 'position': 251}, {'token': 'do', 'token_id': 2079, 'type': 'input', 'position': 252}, {'token': 'something', 'token_id': 2242, 'type': 'input', 'position': 253}, {'token': 'per', 'token_id': 2566, 'type': 'input', 'position': 254}, {'token': '##verse', 'token_id': 16070, 'type': 'input', 'position': 255}, {'token': 'out', 'token_id': 2041, 'type': 'input', 'position': 256}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 257}, {'token': 'simple', 'token_id': 3722, 'type': 'input', 'position': 258}, {'token': 'ing', 'token_id': 13749, 'type': 'input', 'position': 259}, {'token': '##rat', 'token_id': 8609, 'type': 'input', 'position': 260}, {'token': '##itude', 'token_id': 18679, 'type': 'input', 'position': 261}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 262}, {'token': 'simply', 'token_id': 3432, 'type': 'input', 'position': 263}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 264}, {'token': 'gain', 'token_id': 5114, 'type': 'input', 'position': 265}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 266}, {'token': 'point', 'token_id': 2391, 'type': 'input', 'position': 267}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 268}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 269}, {'token': 'if', 'token_id': 2065, 'type': 'input', 'position': 270}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 271}, {'token': 'does', 'token_id': 2515, 'type': 'input', 'position': 272}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 273}, {'token': 'find', 'token_id': 2424, 'type': 'input', 'position': 274}, {'token': 'means', 'token_id': 2965, 'type': 'input', 'position': 275}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 276}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 277}, {'token': 'con', 'token_id': 9530, 'type': 'input', 'position': 278}, {'token': '##tri', 'token_id': 18886, 'type': 'input', 'position': 279}, {'token': '##ve', 'token_id': 3726, 'type': 'input', 'position': 280}, {'token': 'destruction', 'token_id': 6215, 'type': 'input', 'position': 281}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 282}, {'token': 'chaos', 'token_id': 8488, 'type': 'input', 'position': 283}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 284}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 285}, {'token': 'con', 'token_id': 9530, 'type': 'input', 'position': 286}, {'token': '##tri', 'token_id': 18886, 'type': 'input', 'position': 287}, {'token': '##ve', 'token_id': 3726, 'type': 'input', 'position': 288}, {'token': 'suffering', 'token_id': 6114, 'type': 'input', 'position': 289}, {'token': '##s', 'token_id': 2015, 'type': 'input', 'position': 290}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 291}, {'token': 'all', 'token_id': 2035, 'type': 'input', 'position': 292}, {'token': 'sorts', 'token_id': 11901, 'type': 'input', 'position': 293}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 294}, {'token': 'only', 'token_id': 2069, 'type': 'input', 'position': 295}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 296}, {'token': 'gain', 'token_id': 5114, 'type': 'input', 'position': 297}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 298}, {'token': 'point', 'token_id': 2391, 'type': 'input', 'position': 299}, {'token': '!', 'token_id': 999, 'type': 'input', 'position': 300}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 301}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 302}, {'token': 'launch', 'token_id': 4888, 'type': 'input', 'position': 303}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 304}, {'token': 'curse', 'token_id': 8364, 'type': 'input', 'position': 305}, {'token': 'upon', 'token_id': 2588, 'type': 'input', 'position': 306}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 307}, {'token': 'world', 'token_id': 2088, 'type': 'input', 'position': 308}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 309}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 310}, {'token': 'as', 'token_id': 2004, 'type': 'input', 'position': 311}, {'token': 'only', 'token_id': 2069, 'type': 'input', 'position': 312}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 313}, {'token': 'can', 'token_id': 2064, 'type': 'input', 'position': 314}, {'token': 'curse', 'token_id': 8364, 'type': 'input', 'position': 315}, {'token': '(', 'token_id': 1006, 'type': 'input', 'position': 316}, {'token': 'it', 'token_id': 2009, 'type': 'input', 'position': 317}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 318}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 319}, {'token': 'privilege', 'token_id': 14293, 'type': 'input', 'position': 320}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 321}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 322}, {'token': 'primary', 'token_id': 3078, 'type': 'input', 'position': 323}, {'token': 'distinction', 'token_id': 7835, 'type': 'input', 'position': 324}, {'token': 'between', 'token_id': 2090, 'type': 'input', 'position': 325}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 326}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 327}, {'token': 'other', 'token_id': 2060, 'type': 'input', 'position': 328}, {'token': 'animals', 'token_id': 4176, 'type': 'input', 'position': 329}, {'token': ')', 'token_id': 1007, 'type': 'input', 'position': 330}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 331}, {'token': 'may', 'token_id': 2089, 'type': 'input', 'position': 332}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 333}, {'token': 'by', 'token_id': 2011, 'type': 'input', 'position': 334}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 335}, {'token': 'curse', 'token_id': 8364, 'type': 'input', 'position': 336}, {'token': 'alone', 'token_id': 2894, 'type': 'input', 'position': 337}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 338}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 339}, {'token': 'attain', 'token_id': 18759, 'type': 'input', 'position': 340}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 341}, {'token': 'object', 'token_id': 4874, 'type': 'input', 'position': 342}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 343}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 344}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 345}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 346}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 347}, {'token': 'convince', 'token_id': 8054, 'type': 'input', 'position': 348}, {'token': 'himself', 'token_id': 2370, 'type': 'input', 'position': 349}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 350}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 351}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 352}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 353}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 354}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 355}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 356}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 357}, {'token': 'piano', 'token_id': 3682, 'type': 'input', 'position': 358}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 359}, {'token': 'key', 'token_id': 3145, 'type': 'input', 'position': 360}, {'token': '!', 'token_id': 999, 'type': 'input', 'position': 361}, {'token': '[SEP]', 'token_id': 102, 'type': 'input', 'position': 362}], 'factors': [[[0.0019432788249105215, 0.00126641895622015, 0.0006124305073171854, 0.00040618469938635826, 0.0006431636866182089, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0014664223417639732, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.5499571561813354, 0.00021444715093821287, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.9358376264572144, 0.00023394414165522903, 0.0, 0.0, 4.3056239519501105e-05, 0.03998339921236038, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.000901582941878587, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0006673139869235456, 5.403696923167445e-05, 1.7146726846694946, 0.0, 0.0, 0.0, 0.0, 1.098926441045478e-05, 0.0, 0.0, 0.0, 0.0, 0.0, 0.004280527122318745, 0.0, 0.0, 0.0, 0.0, 0.0024736898485571146, 0.0, 0.0003090818936470896, 0.0019563245587050915, 0.0002683851053006947, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 3.856565308524296e-05, 0.0002856575883924961, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.867873191833496, 0.0015741471434012055, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.9817494830931537e-05, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.00010180363460676745, 2.467587728460785e-05, 0.0, 0.0002856870705727488, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.004643863532692194, 0.0, 0.0, 0.00022428507509175688, 0.0, 1.3462251424789429, 0.0002429723390378058, 0.004434915725141764, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.006154949776828289, 0.00021237542387098074, 1.861343502998352, 0.0020585053134709597, 0.0010617597727105021, 0.0, 0.0, 0.0007663600263185799, 0.0005654169945046306, 0.0, 7.781498425174505e-05, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0004480518982745707, 0.0004409262037370354, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0004402877821121365, 0.0, 0.0, 0.0, 0.0, 0.0, 0.00019805255578830838, 0.0, 1.8276294469833374, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.00023703143233433366, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 4.930424620397389e-05, 0.0, 0.0, 0.0, 0.0, 0.00017560443666297942, 0.0003401550347916782, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.003448381321504712, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.006086265668272972, 3.0764247640036047e-05, 0.2882830798625946, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0005649670492857695, 0.0, 0.0, 0.00019952391448896378, 0.0, 0.003449020441621542, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0005078050890006125, 0.0, 0.0, 0.0, 0.0005772847216576338, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 4.034604717162438e-05, 0.0, 0.0, 0.0, 0.003474490949884057, 0.0073116254061460495], [0.01898474432528019, 0.0, 0.0, 0.09845975786447525, 0.0, 0.0, 0.008997233584523201, 0.0, 0.027502821758389473, 0.14934609830379486, 0.0, 0.1244010254740715, 0.02627645619213581, 0.0, 0.0, 0.0, 0.08237456530332565, 0.1516595184803009, 0.02227623015642166, 0.19104784727096558, 0.17280377447605133, 0.0, 0.20518521964550018, 0.10611800104379654, 0.0, 0.06401310116052628, 0.17115828394889832, 0.16201342642307281, 0.0, 0.16939078271389008, 0.0, 0.0, 0.0, 0.14349274337291718, 0.0, 0.1607217788696289, 0.0, 0.0, 0.0, 0.06963402032852173, 0.0, 0.17341308295726776, 0.0, 0.1553647667169571, 0.0, 0.03185110539197922, 0.12362787872552872, 0.01655822992324829, 0.0, 0.14224472641944885, 0.0, 0.12782610952854156, 0.0, 0.17808377742767334, 0.15691623091697693, 0.0, 0.0409434549510479, 0.0, 0.0, 0.023910170421004295, 0.09391311556100845, 0.11409136652946472, 0.11668206751346588, 0.0, 0.13995669782161713, 0.0, 0.21397817134857178, 0.0, 0.23133893311023712, 0.2492430955171585, 0.0, 0.23837906122207642, 0.06361252814531326, 0.07666702568531036, 0.0063894810155034065, 0.19146569073200226, 0.06678775697946548, 0.0, 0.19385887682437897, 0.0, 0.0, 0.04413895681500435, 0.06724347919225693, 0.16463692486286163, 0.09648779779672623, 0.3179800808429718, 0.35119593143463135, 0.3193264901638031, 0.2747075855731964, 0.03577125445008278, 0.2826581299304962, 0.23352724313735962, 0.0, 0.17066849768161774, 0.0, 0.27773070335388184, 0.09082646667957306, 0.10686980187892914, 0.3008490800857544, 0.24666674435138702, 0.029830316081643105, 0.003152000717818737, 0.0, 0.08529461920261383, 0.25717100501060486, 0.05925214663147926, 0.24455836415290833, 0.0326368473470211, 0.03686848282814026, 0.322498619556427, 0.3157764971256256, 0.11916616559028625, 0.24577344954013824, 0.30285656452178955, 0.22019454836845398, 0.05660006031394005, 0.10382366925477982, 0.25419703125953674, 0.31582558155059814, 0.3211907744407654, 0.2615012228488922, 0.32121264934539795, 0.30682244896888733, 0.2504042088985443, 0.009578156284987926, 0.22375769913196564, 0.031036531552672386, 0.31232523918151855, 0.13718633353710175, 0.10795184969902039, 0.0741814449429512, 0.23224978148937225, 0.22740738093852997, 0.22146067023277283, 0.0, 0.27102431654930115, 0.28905248641967773, 0.17122669517993927, 0.0, 0.0, 0.0, 0.049303364008665085, 0.0, 0.2771182060241699, 0.200492724776268, 0.0, 0.0, 0.2530134916305542, 0.23154562711715698, 0.0, 0.0, 0.0, 0.2262236326932907, 0.0, 0.21903780102729797, 0.0, 0.15658003091812134, 0.01802070625126362, 0.11238282173871994, 0.0, 0.2567882239818573, 0.020635977387428284, 0.04200446605682373, 0.0, 0.0, 0.01773887313902378, 0.030999312177300453, 0.0, 0.0, 0.057608455419540405, 0.19553393125534058, 0.0, 0.0, 0.0, 0.1601237803697586, 0.057868171483278275, 0.0, 0.1727646440267563, 0.0, 0.008998807519674301, 0.007642023731023073, 0.22130505740642548, 0.0, 0.005890540778636932, 0.19627819955348969, 0.0, 0.0, 0.0075044697150588036, 0.19831708073616028, 0.029995856806635857, 0.20808084309101105, 0.1933927983045578, 0.0, 0.22431816160678864, 0.044501762837171555, 0.1785743534564972, 0.0, 0.09923818707466125, 0.02851419523358345, 0.0, 0.058361634612083435, 0.15536384284496307, 0.014611729420721531, 0.26177772879600525, 0.12140535563230515, 0.0, 0.06050151214003563, 0.02325466088950634, 0.18493877351284027, 0.0, 0.0, 0.0, 0.0, 0.0, 0.07695278525352478, 0.017162393778562546, 0.0, 0.0064239795319736, 0.1600308120250702, 0.13876189291477203, 0.023285090923309326, 0.1263403594493866, 0.010996720753610134, 0.024423640221357346, 0.219780832529068, 0.09162227809429169, 0.21957886219024658, 0.0, 0.029161470010876656, 0.019081633538007736, 0.0383225753903389, 0.006145533639937639, 0.2331681102514267, 0.047538213431835175, 0.01530228927731514, 0.08319053053855896, 0.24896462261676788, 0.2649412155151367, 0.04794461652636528, 0.2531297206878662, 0.0, 0.040825650095939636, 0.049911126494407654, 0.0, 0.0, 0.062476035207509995, 0.1951231062412262, 0.20556403696537018, 0.0, 0.013548801653087139, 0.007968070916831493, 0.27810320258140564, 0.24249647557735443, 0.15115416049957275, 0.31344807147979736, 0.3000257611274719, 0.18900229036808014, 0.10630641877651215, 0.274072527885437, 0.3535222113132477, 0.32927969098091125, 0.299735426902771, 0.031032266095280647, 0.22670842707157135, 0.05676959827542305, 0.35298818349838257, 0.05810011923313141, 0.29623526334762573, 0.02941957302391529, 0.0, 0.059921808540821075, 0.005986463278532028, 0.07447603344917297, 0.0811891183257103, 0.2609553635120392, 0.19784396886825562, 0.013453233987092972, 0.04898729920387268, 0.3856329619884491, 0.3687942922115326, 0.39981600642204285, 0.2886574864387512, 0.1252996325492859, 0.27126914262771606, 0.08267822116613388, 0.07902879267930984, 0.3917328417301178, 0.3894718587398529, 0.4043911099433899, 0.31260567903518677, 0.2606293857097626, 0.13622498512268066, 0.2090303599834442, 0.27285802364349365, 0.049367621541023254, 0.14478252828121185, 0.09498747438192368, 0.3690270483493805, 0.0862751454114914, 0.29716554284095764, 0.12345128506422043, 0.01584973745048046, 0.0, 0.3004585802555084, 0.11628299951553345, 0.27521976828575134, 0.1878044456243515, 0.0982292965054512, 0.1982971578836441, 0.0, 0.0, 0.049062423408031464, 0.10514931380748749, 0.1920577585697174, 0.05991828069090843, 0.2912304997444153, 0.054305024445056915, 0.05738058686256409, 0.0, 0.001513639115728438, 0.24301213026046753, 0.017936214804649353, 0.045791711658239365, 0.23981842398643494, 0.2009347379207611, 0.12372028082609177, 0.012761702761054039, 0.05173051357269287, 0.11822891980409622, 0.1912645399570465, 0.04248572513461113, 0.0, 0.0012060273438692093, 0.03942548483610153, 0.07577435672283173, 0.007761081214994192, 0.2460426539182663, 0.12687192857265472, 0.0, 0.0, 0.26047465205192566, 0.014752470888197422, 0.21369299292564392, 0.016958901658654213, 0.0, 0.0, 0.0, 0.0, 0.21169055998325348, 0.05222175270318985, 0.002043256303295493, 0.0, 0.0, 0.012628762982785702, 0.16097600758075714, 0.0, 0.04668239504098892, 0.05260888487100601, 0.21597062051296234, 0.10825635492801666, 0.21141894161701202, 0.06591743230819702, 0.01180829107761383], [0.040564775466918945, 0.035246413201093674, 0.08357974886894226, 0.0, 0.10583794862031937, 0.0011027876753360033, 0.0, 0.0, 0.0005395854823291302, 0.0, 0.010199155658483505, 0.22790777683258057, 0.0, 0.6401037573814392, 0.03433489799499512, 0.06410249322652817, 0.04306668043136597, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.6569098234176636, 0.004494818393141031, 0.008711391128599644, 0.0, 0.0, 0.0, 0.6237695813179016, 0.0, 0.031401339918375015, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.5799325108528137, 0.0, 0.0, 0.0, 0.0, 0.0, 0.6721481084823608, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.48612672090530396, 0.0, 0.0, 0.0, 0.0, 0.6750775575637817, 0.01093077752739191, 0.0, 0.0, 0.0, 0.01268216222524643, 0.0, 0.0, 0.0029164801817387342, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.24810931086540222, 0.0, 0.0, 0.16336467862129211, 0.05027332156896591, 0.0, 0.0, 0.027489347383379936, 0.7446931004524231, 0.0, 0.0, 0.0, 0.577173113822937, 0.0, 0.04923662543296814, 0.0281801987439394, 0.002862288849428296, 0.0, 0.0755077600479126, 0.030933139845728874, 0.0, 0.0, 0.0, 0.09390737116336823, 0.05401421710848808, 0.0, 0.0, 0.0, 0.01739434525370598, 0.0, 0.01611846312880516, 0.0, 0.01036534458398819, 0.0, 0.0, 0.0, 0.035180024802684784, 0.08427826315164566, 0.0, 0.010502119548618793, 0.0283600315451622, 0.6383859515190125, 0.0, 0.027545936405658722, 0.0, 0.0, 0.09728411585092545, 0.003439925145357847, 0.0, 0.6995370388031006, 0.014082430861890316, 0.0, 0.0, 0.6522952318191528, 0.0, 0.0, 0.0035931263118982315, 0.7985443472862244, 0.0, 0.0, 0.033622875809669495, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0033287585247308016, 0.0, 0.0001863094512373209, 0.5703058838844299, 0.0, 0.0, 0.0, 0.0, 0.03282806649804115, 0.0, 0.011010171845555305, 0.0, 0.0, 0.0, 0.0, 0.14352811872959137, 0.0, 0.0, 0.11091103404760361, 0.0, 0.0, 0.05316946655511856, 0.0, 0.0, 0.1058477908372879, 0.0, 0.0, 0.0, 0.07427062094211578, 0.0, 0.027965256944298744, 0.043663833290338516, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.017463043332099915, 0.14495746791362762, 0.0, 0.046209655702114105, 0.02018040604889393, 0.009833241812884808, 0.0, 0.022286947816610336, 0.0, 0.0, 0.05980901047587395, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.2787534296512604, 0.01029923278838396, 0.0, 0.016887230798602104, 0.0, 0.11004424840211868, 0.003795405151322484, 0.04169567674398422, 0.0, 0.0, 0.0, 0.0, 0.09305886924266815, 0.0, 0.0, 0.0, 0.7282660007476807, 0.0, 0.0014098971150815487, 0.00029337211162783206, 0.0, 0.0, 0.0, 0.0, 0.03310529142618179, 0.7527598738670349, 0.0, 0.0, 0.005877531133592129, 0.0, 0.0, 0.0, 0.0, 0.0, 0.012718996964395046, 0.04848131909966469, 0.0, 0.0, 0.0, 0.010795943439006805, 0.0, 0.0, 0.0, 0.023200877010822296, 0.007637341506779194, 0.0, 0.0, 0.015525832772254944, 0.7517939805984497, 0.011637989431619644, 0.021575815975666046, 0.011354212649166584, 0.003557812422513962, 0.8185064792633057, 0.001087847980670631, 0.0, 0.0, 0.0, 0.7712413668632507, 0.02452678233385086, 0.016124721616506577, 0.0, 0.0010295530082657933, 0.0, 0.009221243672072887, 0.0034454490523785353, 0.03893555700778961, 0.034717269241809845, 0.03208310529589653, 0.0, 0.017142584547400475, 0.0, 0.0709502175450325, 0.018398171290755272, 0.05193603038787842, 0.008509264327585697, 0.02820151299238205, 0.0, 0.03347219154238701, 0.04557391256093979, 0.8111382126808167, 0.04437102749943733, 0.06553229689598083, 0.7899371981620789, 0.027151603251695633, 0.0, 0.17503145337104797, 0.02661008946597576, 0.023140912875533104, 0.17631743848323822, 0.0810956209897995, 0.01716228574514389, 0.029836727306246758, 0.033485978841781616, 0.03573819622397423, 0.32221728563308716, 0.04057815298438072, 0.01558830589056015, 0.027596401050686836, 0.1465480476617813, 0.057598188519477844, 0.8214860558509827, 0.0, 0.03113524615764618, 0.10771434754133224, 0.011619174852967262, 0.0, 0.012098699808120728, 0.8021427392959595, 0.04292621836066246, 0.1055532842874527, 0.05971260741353035, 0.04438042268157005, 0.052366264164447784, 0.0, 0.04779621586203575, 0.011570141650736332, 0.8734295964241028, 0.041116178035736084, 0.01888815313577652, 0.7581003904342651, 0.0, 0.0, 0.8303691148757935, 0.025368155911564827, 0.0, 0.0, 0.0, 0.010538631118834019, 0.00937015563249588, 0.0, 0.5838102102279663, 0.06383471935987473, 0.8388391137123108, 0.05861661210656166, 0.14340840280056, 0.2553795576095581, 0.00569389620795846, 0.01790560781955719, 0.16049717366695404, 0.024406807497143745, 0.07810000330209732, 0.03089304082095623, 0.04759865626692772, 0.024244263768196106], [0.014477604068815708, 0.018636053428053856, 0.09740076959133148, 0.0601017102599144, 0.03377950191497803, 0.009791724383831024, 0.0025129844434559345, 0.3120904266834259, 0.12151743471622467, 0.0, 0.0, 0.0, 0.0, 0.0, 0.218280628323555, 0.0, 0.002900323597714305, 0.0, 0.0, 0.0, 0.0, 0.09874250739812851, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.02074294723570347, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.37210720777511597, 0.12202442437410355, 0.0, 0.0, 0.0, 0.0, 0.09567254781723022, 0.03824992477893829, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.24119390547275543, 0.07973452657461166, 0.0, 0.0009578323224559426, 0.1673687994480133, 0.057448577135801315, 0.00459692906588316, 0.0, 0.051832251250743866, 0.0, 0.0, 0.0376460887491703, 0.0, 0.0, 0.004876358900219202, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.026259640231728554, 0.003637530142441392, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0022029399406164885, 0.0, 0.0, 0.008385947905480862, 0.507425844669342, 0.014460117556154728, 0.03976131230592728, 0.008542463183403015, 0.0, 0.0, 0.02740057371556759, 0.047588273882865906, 0.5334818959236145, 0.08397848159074783, 0.01402620691806078, 0.0, 0.0021503178868442774, 0.017635338008403778, 0.498713880777359, 0.04527593031525612, 0.025345206260681152, 0.007604357320815325, 0.01564471796154976, 0.0, 0.0, 0.0, 0.01968715898692608, 0.027861112728714943, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.029622113332152367, 0.25300464034080505, 0.0, 0.01223813183605671, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0007122848182916641, 0.2661067247390747, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.016076207160949707, 0.5859689116477966, 0.0768144428730011, 0.2456256002187729, 0.0002484662691131234, 0.0, 0.0024746647104620934, 0.029265429824590683, 0.053170155733823776, 0.2548418939113617, 0.011591169051826, 0.049489494413137436, 0.0, 0.0, 0.0, 0.0, 0.012342325411736965, 0.0, 0.13399280607700348, 0.013949746266007423, 0.0014138903934508562, 0.0, 0.0, 0.0, 0.01228528656065464, 0.03605625405907631, 0.17735667526721954, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.07537537068128586, 0.17329011857509613, 0.0032488040160387754, 0.0, 0.0, 0.0, 0.04229384660720825, 0.03540870547294617, 0.6027913093566895, 0.18973474204540253, 0.08295407146215439, 0.18394097685813904, 0.03161425516009331, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.2164846956729889, 0.022710155695676804, 0.0, 0.0, 0.0, 0.03833834081888199, 0.005066652316600084, 0.02217162773013115, 0.13523095846176147, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.04107367992401123, 0.0, 0.1499529927968979, 0.004694321192800999, 0.04911346733570099, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.03474576026201248, 0.022114593535661697, 0.4827372133731842, 0.10158959031105042, 0.06167713552713394, 0.0, 0.0, 0.0, 0.4488786458969116, 0.027707025408744812, 0.08037342876195908, 0.002376243704929948, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.00571836531162262, 0.0, 0.010298032313585281, 0.22297027707099915, 0.03151008114218712, 0.0, 0.0032580974511802197, 0.0, 0.0, 0.0522768571972847, 0.024913469329476357, 0.2823067903518677, 0.11602481454610825, 0.029004473239183426, 0.038368597626686096, 0.04873267561197281, 0.6019229888916016, 0.03402082994580269, 0.0025256345979869366, 0.02207132801413536, 0.0, 0.0, 0.0, 0.020105697214603424, 0.4924110472202301, 0.016912853345274925, 0.0, 0.004465446807444096, 0.0, 0.009879305958747864, 0.0, 0.0, 0.0, 0.005704174283891916, 0.0034808400087058544, 0.24235093593597412, 0.03799406811594963, 0.001532977563329041, 0.012771240435540676, 0.061117567121982574, 0.05808332934975624, 0.6523306369781494, 0.02414129115641117, 0.05597210302948952, 0.013058090582489967, 0.0247498806566, 0.0024343000259250402, 0.006259107496589422, 0.0, 0.0, 0.011501752771437168, 0.011516786180436611, 0.035643141716718674, 0.3851257562637329, 0.022969892248511314, 0.024227172136306763, 0.008361831307411194, 0.25549420714378357, 0.0, 0.0, 0.0, 0.002003811066970229, 0.0, 0.0, 0.00017092871712520719, 0.0, 0.0, 0.0, 0.0, 0.021529054269194603, 0.007715487387031317, 0.3052217960357666, 0.11986325681209564, 0.015291089192032814, 0.004023937974125147, 0.018668223172426224, 0.002277107210829854, 0.03653845936059952, 0.644137978553772, 0.016429895535111427, 0.0008423580438829958, 0.004686686210334301, 0.0, 0.0, 0.0, 0.14826235175132751, 0.07459133863449097, 0.0048849619925022125, 0.0, 0.0041654654778540134, 0.0, 0.27146053314208984, 0.014588775113224983, 0.005298965610563755, 0.0012489469954743981, 0.019018732011318207, 0.00610126368701458, 0.0, 0.013651011511683464, 0.0, 0.0558323971927166, 0.0], [0.024222275242209435, 0.01011196244508028, 0.007405109237879515, 0.0, 0.004263773560523987, 0.0895422175526619, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.002782524563372135, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.10548647493124008, 0.0, 0.0, 0.0, 0.001913420739583671, 0.0, 0.0, 0.6410499811172485, 0.0, 0.0, 0.030953314155340195, 0.0, 0.0, 0.0, 0.0, 1.0476223230361938, 0.04558596387505531, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.006189809180796146, 0.0, 0.0, 0.22654788196086884, 0.006908595561981201, 0.0, 0.0, 0.0, 0.8423362970352173, 0.03425350785255432, 0.008687685243785381, 0.003957307431846857, 0.0034364615567028522, 0.0, 0.0, 0.0, 0.03364218398928642, 0.009891553781926632, 0.03560128062963486, 0.0, 0.5745986104011536, 0.0, 0.0, 0.19431455433368683, 0.0, 0.0, 0.047781966626644135, 0.0, 0.0, 0.03248017281293869, 0.0, 0.0038966755382716656, 1.12740957736969, 0.24647195637226105, 0.04689788445830345, 0.06185898557305336, 0.054981451481580734, 0.050509996712207794, 0.0, 0.0, 0.0012550805695354939, 0.0, 0.7212935090065002, 0.007630138657987118, 0.024840770289301872, 0.9907834529876709, 0.052570052444934845, 0.0457259900867939, 0.021984895691275597, 0.06686924397945404, 0.05646713450551033, 0.002285233698785305, 0.012538647279143333, 0.13284318149089813, 0.056780457496643066, 0.04244822636246681, 0.0380631685256958, 0.0038912638556212187, 0.027734702453017235, 0.0023073763586580753, 0.22183234989643097, 0.04698948562145233, 0.005939156748354435, 0.0055533782579004765, 0.06273321062326431, 0.0433557964861393, 0.0, 0.0042557683773338795, 0.7984476089477539, 0.10741958767175674, 0.053833235055208206, 0.0, 0.0, 0.0, 0.016895167529582977, 0.0, 0.04085002467036247, 1.1987481117248535, 0.03791055083274841, 0.07419617474079132, 0.005874081049114466, 0.013998635113239288, 0.0005826575797982514, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.6023282408714294, 0.0, 0.0, 0.0, 0.017179427668452263, 0.0, 0.0, 0.0, 0.0, 0.0, 0.7531450390815735, 0.0042413342744112015, 0.03639492020010948, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.026254378259181976, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.01734783686697483, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0646507665514946, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.585854172706604, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.010408712550997734, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.05169341713190079, 0.0, 0.0, 0.0, 0.0, 0.10944753140211105, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.7751500010490417, 0.0, 0.0009382569114677608, 0.0, 0.0033046510070562363, 0.0, 0.0, 0.0, 0.0016308920457959175, 0.0, 0.0, 0.06337722390890121, 0.0, 0.8634165525436401, 0.0, 0.029468988999724388, 0.0, 0.0, 0.0, 0.0, 0.0, 0.9011325836181641, 0.10275435447692871, 0.015889935195446014, 0.0, 0.0072034504264593124, 0.0, 0.0, 0.0, 0.026373770087957382, 0.013437452726066113, 0.0, 0.0, 0.0, 0.0, 0.9281446933746338, 0.01777411252260208, 0.051584310829639435, 0.0, 0.0, 0.0032441457733511925, 0.09359637647867203, 0.13452322781085968, 0.013892649672925472, 0.0, 0.0, 0.0, 0.004743089433759451, 0.024733465164899826, 0.05774139612913132, 0.0, 0.008493266999721527, 0.0014943927526474, 0.012594188563525677, 0.0, 0.12715983390808105, 0.013121504336595535, 0.7524927258491516, 0.03817931190133095, 0.021014178171753883, 0.003604371566325426, 0.020764794200658798, 0.004321432206779718, 0.05189652740955353, 0.06861059367656708, 0.009530994109809399, 0.0, 1.0355870723724365, 0.08367641270160675, 0.08605176210403442, 0.0037605068646371365, 0.02437218278646469, 0.015096408315002918, 0.12415190041065216, 0.057298753410577774, 0.0040284120477736, 0.014394491910934448, 0.03500958904623985, 0.0, 0.0033308728598058224, 0.006646883673965931, 0.004543708637356758, 0.9709075093269348, 0.17544037103652954, 0.021881116554141045, 0.0, 0.0, 0.0, 0.0, 0.12049759924411774, 0.0, 0.0, 0.0, 0.0, 0.6335961818695068, 0.039717890322208405, 0.0, 0.0, 0.0, 0.0, 0.028840411454439163, 0.0, 0.0, 0.13899856805801392, 0.7891056537628174, 0.010814329609274864, 0.016184046864509583, 0.0, 0.0, 0.0, 0.004455069545656443, 0.01575721614062786, 0.0, 0.0, 0.0, 0.0, 0.0, 0.006310236174613237, 0.0, 0.0, 0.6182204484939575, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.08940917253494263, 0.0, 0.0, 0.0, 0.00736466608941555, 0.0, 0.072122722864151, 0.037073031067848206], [0.05600137636065483, 0.2536357045173645, 0.39517953991889954, 0.23340219259262085, 0.3701781630516052, 0.40177083015441895, 0.47238096594810486, 0.4576360881328583, 0.6555734872817993, 0.28521043062210083, 0.7960371375083923, 0.25986698269844055, 0.42198047041893005, 0.3148900866508484, 0.5279350280761719, 0.685620903968811, 0.36010995507240295, 0.2622145414352417, 0.6891225576400757, 0.26430848240852356, 0.2179892361164093, 0.41625750064849854, 0.2175832837820053, 0.4761735498905182, 0.3444584012031555, 0.46444809436798096, 0.19581574201583862, 0.16741026937961578, 0.4399750828742981, 0.2375240921974182, 0.3253692090511322, 0.7024431824684143, 0.7514692544937134, 0.22958344221115112, 0.8373488187789917, 0.2002374231815338, 0.27781492471694946, 0.46691882610321045, 0.5404420495033264, 0.2997458279132843, 0.3724346458911896, 0.11806380748748779, 0.7727958559989929, 0.15966258943080902, 0.3808022141456604, 0.5570782423019409, 0.3407192826271057, 0.5024616122245789, 0.43778756260871887, 0.17441020905971527, 0.30630379915237427, 0.34481188654899597, 0.25380638241767883, 0.18289408087730408, 0.1851533204317093, 0.2570369243621826, 0.24919819831848145, 0.4432384967803955, 0.22834530472755432, 0.24787494540214539, 0.3905556797981262, 0.21696485579013824, 0.21697866916656494, 0.5229039192199707, 0.309248685836792, 0.26294100284576416, 0.13053014874458313, 0.2929636538028717, 0.13681234419345856, 0.056851767003536224, 0.3319597542285919, 0.1351560354232788, 0.13476860523223877, 0.37517470121383667, 0.29037192463874817, 0.11747734993696213, 0.5361726880073547, 0.17975923418998718, 0.09900038689374924, 0.08627818524837494, 0.14998258650302887, 0.08254857361316681, 0.1970054656267166, 0.2660782039165497, 0.4905717968940735, 0.08275459706783295, 0.02351561188697815, 0.03391021117568016, 0.04223662614822388, 0.15100771188735962, 0.07205476611852646, 0.050247322767972946, 0.14413191378116608, 0.034431662410497665, 0.08407578617334366, 0.09328659623861313, 0.21382370591163635, 0.32474803924560547, 0.04392339289188385, 0.047295186668634415, 0.0, 0.005186291411519051, 0.04136472940444946, 0.09930942952632904, 0.002840750152245164, 0.10247183591127396, 0.0, 0.10423898696899414, 0.019626185297966003, 0.018990807235240936, 0.0, 0.41494545340538025, 0.18300169706344604, 0.0, 0.0, 0.08483318984508514, 0.34786200523376465, 0.20000934600830078, 0.07046102732419968, 0.0747380256652832, 0.026859872043132782, 0.15414680540561676, 0.0, 0.04316510260105133, 0.01653374545276165, 0.048666100949048996, 0.35674744844436646, 0.04867527261376381, 0.3227396607398987, 0.21238239109516144, 0.32842668890953064, 0.08134628087282181, 0.16783204674720764, 0.18000206351280212, 0.24434883892536163, 0.07065774500370026, 0.061746951192617416, 0.09940597414970398, 0.1279623955488205, 0.3264123797416687, 0.31752321124076843, 0.23290294408798218, 0.173589289188385, 0.04485975205898285, 0.06465573608875275, 0.23714813590049744, 0.1772376000881195, 0.07231184095144272, 0.03911556676030159, 0.3661733567714691, 0.12203370034694672, 0.04213226959109306, 0.08689700067043304, 0.4465959668159485, 0.060278601944446564, 0.19699494540691376, 0.0824388861656189, 0.4588751792907715, 0.22678536176681519, 0.47954878211021423, 0.08891964703798294, 0.48151087760925293, 0.0492069311439991, 0.009833295829594135, 0.06060915067791939, 0.12330970913171768, 0.11895155161619186, 0.17693015933036804, 0.24420253932476044, 0.2732239365577698, 0.09138321131467819, 0.0, 0.04361028969287872, 0.21489204466342926, 0.06590929627418518, 0.07801816612482071, 0.19903801381587982, 0.06231364980340004, 0.15094807744026184, 0.1424580067396164, 0.5251893997192383, 0.06314776092767715, 0.5462633967399597, 0.4604896008968353, 0.04902473837137222, 0.0, 0.20838221907615662, 0.48977258801460266, 0.08862581849098206, 0.5970377326011658, 0.08864425867795944, 0.056080304086208344, 0.405288428068161, 0.08770830184221268, 0.2375345677137375, 0.06036011129617691, 0.22403547167778015, 0.06276586651802063, 0.11489305645227432, 0.05773017928004265, 0.23564903438091278, 0.09182341396808624, 0.3629402816295624, 0.012850583530962467, 0.06566336750984192, 0.06521777808666229, 0.1917651891708374, 0.4109271466732025, 0.005857681855559349, 0.0, 0.0, 0.04101802408695221, 0.07876189053058624, 0.03710590675473213, 0.028381099924445152, 0.04585986211895943, 0.0, 0.03943133354187012, 0.0, 0.0, 0.06168094277381897, 0.023871751502156258, 0.08801401406526566, 0.2876926362514496, 0.0, 0.11534110456705093, 0.0, 0.0, 0.0, 0.0008912296034395695, 0.021206626668572426, 0.06166618689894676, 0.0, 0.26706159114837646, 0.0, 0.15727059543132782, 0.04150436073541641, 0.010590597055852413, 0.09264320135116577, 0.0, 0.0, 0.0, 0.00025139079662039876, 0.0, 0.0, 0.0, 0.008393537253141403, 0.0, 0.0, 0.0, 0.0, 0.0, 0.027488086372613907, 0.037834156304597855, 0.05358424410223961, 0.0, 0.09900297224521637, 0.31515175104141235, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.22069789469242096, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.08798213303089142, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.06808966398239136, 0.3227669298648834, 0.04640275612473488, 0.0, 0.0, 0.0, 0.15548455715179443, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.23383504152297974, 0.0, 0.13460136950016022, 0.3507275879383087, 0.027437491342425346, 0.0, 0.0, 0.0, 0.03537517413496971, 0.0, 0.05244337022304535, 0.0, 0.0, 0.03131169453263283, 0.05816182494163513, 0.0, 0.0, 0.0, 0.23451146483421326, 0.05471019819378853, 0.01158108189702034, 0.10753695666790009, 0.0, 0.06883145123720169, 0.10986185818910599, 0.0, 0.0, 0.0, 0.0, 0.044542454183101654, 0.1262674182653427, 0.0007452715071849525, 0.0, 0.019735392183065414, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.10777273029088974, 0.0, 0.04458589106798172, 0.20701053738594055, 0.0, 0.0, 0.0, 0.25104808807373047, 0.0, 0.07529330998659134, 0.0, 0.0, 0.02782408893108368], [0.05359618365764618, 0.17151089012622833, 0.029148591682314873, 0.006640616804361343, 0.004468464758247137, 0.0472804494202137, 0.10303478688001633, 0.0, 0.0, 0.0, 0.0, 0.0, 0.05820892006158829, 0.0, 0.013734928332269192, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0011441675014793873, 0.0, 0.0, 0.0, 0.0, 0.0, 0.08525393903255463, 0.24188458919525146, 0.10171838849782944, 0.26200225949287415, 0.0, 0.0, 0.0, 0.0, 0.017119858413934708, 0.008668121881783009, 0.05256965756416321, 0.0, 0.0, 0.006303419824689627, 0.050825897604227066, 0.0, 0.0, 0.0, 0.0, 0.10268817096948624, 0.3012889325618744, 0.0, 0.0, 0.05257445573806763, 0.14826282858848572, 0.09931719303131104, 0.0, 0.038524873554706573, 0.2817898690700531, 0.0, 0.0, 0.0, 0.0, 0.15604209899902344, 0.0, 0.0, 0.011083363555371761, 0.0, 0.0, 0.012038078159093857, 0.0, 0.0, 0.0, 0.3452991545200348, 0.31272026896476746, 0.2206922173500061, 0.12092559784650803, 0.08344905078411102, 0.001043597818352282, 0.0, 0.0, 0.0, 0.0, 0.0015368813183158636, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.043614502996206284, 0.0, 0.0, 0.0, 0.0, 0.0, 0.18352332711219788, 0.0, 0.0, 0.0, 0.19318974018096924, 0.0, 0.0, 0.0, 0.051242027431726456, 0.0291935782879591, 0.0, 0.0, 0.0, 0.06443935632705688, 0.02767576090991497, 0.010307773016393185, 0.0011309904512017965, 0.0, 0.01710343174636364, 0.0, 0.0, 0.0, 0.11923368275165558, 0.0, 0.0, 0.06418529152870178, 0.12297362834215164, 0.0579795278608799, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.23221826553344727, 0.18538133800029755, 0.23167040944099426, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.23047812283039093, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.16259124875068665, 0.12972049415111542, 0.10025272518396378, 0.0, 0.0, 0.075400210916996, 0.0, 0.0, 0.0, 0.23351427912712097, 0.2337217926979065, 0.3116430342197418, 0.21257449686527252, 0.14226655662059784, 0.05038977414369583, 0.0, 0.0, 0.29193100333213806, 0.011045924387872219, 0.17392925918102264, 0.13477997481822968, 0.006768209859728813, 0.3456668257713318, 0.2848828136920929, 0.10185360163450241, 0.0, 0.06779645383358002, 0.06708122044801712, 0.0, 0.0, 0.21675804257392883, 0.10678674280643463, 0.05386677384376526, 0.08878874033689499, 0.034412968903779984, 0.01507165003567934, 0.05535384267568588, 0.03966004401445389, 0.1989574432373047, 0.11651704460382462, 0.4272378981113434, 0.19706858694553375, 0.1415330320596695, 0.015149126760661602, 0.13181912899017334, 0.10592576116323471, 0.11920218169689178, 0.03922915458679199, 0.18965744972229004, 0.3876129388809204, 0.14934824407100677, 0.1193525493144989, 0.03263231739401817, 0.10070423781871796, 0.5440061092376709, 0.6103132963180542, 0.44453203678131104, 0.44953712821006775, 0.36476394534111023, 0.2835363745689392, 0.44166404008865356, 0.36513039469718933, 0.09771860390901566, 0.2544907033443451, 0.3039568364620209, 0.25271448493003845, 0.4513413906097412, 0.19309045374393463, 0.024713672697544098, 0.13565964996814728, 0.04836108908057213, 0.195151224732399, 0.41710612177848816, 0.3525090515613556, 0.36301448941230774, 0.3222329020500183, 0.12503346800804138, 0.23873819410800934, 0.12738314270973206, 0.22907696664333344, 0.07378526777029037, 0.07693783938884735, 0.300252228975296, 0.06407630443572998, 0.14846475422382355, 0.44478917121887207, 0.3548327684402466, 0.11799546331167221, 0.10916918516159058, 0.32067370414733887, 0.13288792967796326, 0.06692550331354141, 0.11210097372531891, 0.401121586561203, 0.08906289935112, 0.07669149339199066, 0.15223915874958038, 0.23838259279727936, 0.13523760437965393, 0.03438614681363106, 0.2675152122974396, 0.2328033745288849, 0.06604724377393723, 0.038969915360212326, 0.0406612791121006, 0.05049257352948189, 0.10868807882070541, 0.2075127363204956, 0.17837131023406982, 0.027048295363783836, 0.051622577011585236, 0.04270550608634949, 0.09330210089683533, 0.5657671689987183, 0.3045947551727295, 0.07301171869039536, 0.19621869921684265, 0.3353513181209564, 0.06706209480762482, 0.0688912495970726, 0.07718759775161743, 0.0, 0.03300376981496811, 0.0, 0.0, 0.0, 0.22615309059619904, 0.0, 0.04802772030234337, 0.0, 0.0140826515853405, 0.0, 0.0, 0.0, 0.10598693042993546, 0.2065068483352661, 0.22828719019889832, 0.11463014036417007, 0.06248462572693825, 0.2794170677661896, 0.116827093064785, 0.0, 0.00023424399842042476, 0.014055771753191948, 0.08855416625738144, 0.03771989420056343, 0.0, 0.0, 0.06474699825048447, 0.0, 0.05453725904226303, 0.10811770707368851, 0.04130656644701958, 0.0, 0.42592981457710266, 0.2769893407821655, 0.26438212394714355, 0.010826398618519306, 0.022529905661940575, 0.0, 0.09958674758672714, 0.25932854413986206, 0.24016624689102173, 0.0, 0.0, 0.0486576147377491, 0.17594154179096222, 0.04976139962673187, 0.04458506405353546, 0.13353709876537323, 0.02264520153403282, 0.26597651839256287, 0.1437220275402069, 0.02396007627248764, 0.06488843262195587, 0.028680378571152687, 0.09117909520864487, 0.22528648376464844, 0.20117399096488953, 0.03878266364336014, 0.0, 0.18049028515815735, 0.061534520238637924, 0.0, 0.028623202815651894, 0.05697789788246155, 0.03588046506047249, 0.0, 0.0793512761592865, 0.6227498054504395, 0.49197420477867126, 0.17568790912628174, 0.0609874427318573, 0.08315669745206833, 0.38487812876701355, 0.07666981220245361, 0.2109011709690094, 0.16758029162883759, 0.043467532843351364, 0.38663536310195923, 0.31448614597320557, 0.1290866881608963, 0.0, 0.04578002914786339, 0.0, 0.08793877065181732, 0.30135267972946167], [0.023197006434202194, 0.05484233424067497, 0.030851637944579124, 0.01387003157287836, 0.07662171870470047, 0.25555557012557983, 0.005364788230508566, 0.0, 0.0, 0.0, 0.0, 0.012157212011516094, 0.05818722024559975, 0.0, 0.0, 0.0, 0.0012096515856683254, 0.0, 0.0, 0.0, 0.0, 0.17686645686626434, 0.0, 0.006941067520529032, 0.0, 0.0, 0.009851781651377678, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.06191251799464226, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.15998095273971558, 0.0, 0.0, 0.0, 0.0, 0.0, 0.05465482920408249, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.003730347380042076, 0.05960460752248764, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.024189596995711327, 0.009790676645934582, 0.0, 0.0, 0.0, 0.0, 0.022467520087957382, 0.032246485352516174, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.05057657137513161, 0.027449121698737144, 0.0, 0.0, 0.0162376556545496, 0.015189597383141518, 0.0, 0.0, 0.0063831075094640255, 0.0, 0.039639901369810104, 0.0, 0.0, 0.008273589424788952, 0.04035221040248871, 0.06077899783849716, 0.007399602793157101, 0.026936160400509834, 0.053377583622932434, 0.04109205678105354, 0.014794894494116306, 0.012434778735041618, 0.04080181568861008, 0.10959821939468384, 0.053303517401218414, 0.02146473340690136, 0.01694762334227562, 0.0233272947371006, 0.02111242339015007, 0.03621229901909828, 0.08270440995693207, 0.0539197213947773, 0.012758330442011356, 0.023784754797816277, 0.05638337507843971, 0.025860486552119255, 0.013818888925015926, 0.03880202770233154, 0.020486105233430862, 0.03653041645884514, 0.12388714402914047, 0.07645276933908463, 0.06022616848349571, 0.059408433735370636, 0.05564333498477936, 0.04237456992268562, 0.08820518851280212, 0.07523943483829498, 1.324087381362915, 1.1365888118743896, 0.20756866037845612, 0.07894402742385864, 0.06560149043798447, 0.013544152490794659, 0.06096990779042244, 0.04944954812526703, 1.328036904335022, 1.1154272556304932, 0.13119466602802277, 0.06861221790313721, 0.053630273789167404, 0.03634690120816231, 0.06892174482345581, 0.06585641950368881, 0.03436888009309769, 0.022430874407291412, 0.04863952472805977, 0.026294158771634102, 0.011080251075327396, 0.03436075523495674, 0.008764210157096386, 0.09561537951231003, 0.027121255174279213, 0.017059188336133957, 0.035524919629096985, 0.023492436856031418, 0.03234129399061203, 0.03831672668457031, 0.0327426977455616, 0.06946961581707001, 0.03775331377983093, 0.0681115910410881, 0.03145277500152588, 0.043416135013103485, 0.02613743580877781, 0.0, 0.0, 0.0, 0.009306912310421467, 0.004719132091850042, 0.020306365564465523, 0.03542352467775345, 0.008730405941605568, 0.011037989519536495, 0.14122453331947327, 0.1608901470899582, 0.0, 0.0, 0.0, 0.0, 0.2660927176475525, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.041325103491544724, 0.5142449736595154, 0.04131310060620308, 0.0, 0.0006679908256046474, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.01385488174855709, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.016304653137922287, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.007500974927097559, 0.034425944089889526, 0.07165579497814178, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0028460556641221046, 0.0, 0.0, 0.0, 0.0, 0.026480553671717644, 0.026206478476524353, 0.001120765577070415, 0.009027047082781792, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.020585747435688972, 0.16754773259162903, 0.0, 0.0, 0.0, 0.0, 0.015670308843255043, 0.01118611078709364, 0.0, 0.027512380853295326, 0.06528621166944504, 0.15538543462753296, 0.06246376037597656, 0.0, 0.031987059861421585, 0.0024518328718841076, 0.007589871529489756, 0.30676013231277466, 0.024025246500968933, 0.0, 0.0, 0.003008487168699503, 0.03428537771105766, 0.028399845585227013, 0.0, 0.0034385297913104296, 0.008571850135922432, 0.020915545523166656, 0.0, 0.0, 0.03018801100552082, 0.2771296203136444, 0.09687625616788864, 0.08584862947463989, 0.07421542704105377, 0.026736723259091377, 0.017808612436056137, 0.0302504263818264, 0.02053588069975376, 0.042835503816604614, 0.025566479191184044, 0.0031428339425474405, 0.020993132144212723, 0.04790719598531723, 1.2795203924179077, 1.1455217599868774, 0.10538016259670258, 0.051472149789333344, 0.0019789785146713257, 0.0, 0.0005404318799264729, 0.0030863024294376373, 0.0, 0.0, 0.0, 0.03241918608546257, 0.013265619985759258, 0.002872779965400696, 0.00948471762239933, 0.08116172254085541, 0.593268871307373, 0.10645825415849686, 0.23920883238315582, 0.0]]]})\n",
              "         }, function (err) {\n",
              "            console.log(err);\n",
              "        })"
            ],
            "text/plain": [
              "<IPython.core.display.Javascript object>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "6h5JzHHdB0Bu"
      },
      "source": [
        "# Factorize the activations of only the first layer\n",
        "nmf_2 = output.run_nmf(n_components=8, from_layer=0, to_layer=1)"
      ],
      "execution_count": 59,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "v3KN4E54B3_f",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 394
        },
        "outputId": "fbdb2cbe-e2ad-4abb-aed9-0dc15933cedf"
      },
      "source": [
        "nmf_2.explore()"
      ],
      "execution_count": 60,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<html lang=\"en\">\n",
              "<script src=\"https://requirejs.org/docs/release/2.3.6/minified/require.js\"></script>\n",
              "<script>\n",
              "    var ecco_url = 'https://storage.googleapis.com/ml-intro/ecco/'\n",
              "    // var ecco_url = 'http://localhost:8000/ecco/'\n",
              "\n",
              "    if (window.ecco === undefined) window.ecco = {}\n",
              "\n",
              "    requirejs.config({\n",
              "        urlArgs: \"bust=\" + (new Date()).getTime(),\n",
              "        nodeRequire: require,\n",
              "        paths: {\n",
              "            d3: \"https://d3js.org/d3.v5.min\",\n",
              "            \"d3-array\": \"https://d3js.org/d3-array.v2.min\",\n",
              "            jquery: \"https://code.jquery.com/jquery-3.5.1.min\",\n",
              "            // oldEcco: ecco_url + 'ecco',\n",
              "            ecco: ecco_url + 'js/0.0.4/ecco-bundle.min',\n",
              "            xregexp: 'https://cdnjs.cloudflare.com/ajax/libs/xregexp/3.2.0/xregexp-all.min'\n",
              "        }\n",
              "    });\n",
              "    requirejs(['d3'],\n",
              "        function (d3) {\n",
              "            d3.select('#css').attr('href', ecco_url + 'html/styles.css')\n",
              "        })\n",
              "\n",
              "    console.log('Ecco initialize.')\n",
              "</script>\n",
              "\n",
              "<head>\n",
              "    <link id='css' rel=\"stylesheet\" type=\"text/css\">\n",
              "</head>\n"
            ],
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ]
          },
          "metadata": {
            "tags": []
          }
        },
        {
          "output_type": "display_data",
          "data": {
            "text/html": [
              "<script>\n",
              "    // console.log('defining basic')\n",
              "    define('basic', ['d3'],\n",
              "        function (d3) {\n",
              "            return {\n",
              "                init: function (viz_id = null) {\n",
              "\n",
              "                    // console.log('basic init')\n",
              "                    if (viz_id == null){\n",
              "                        viz_id = \"viz_\" + Math.round(Math.random() * 10000000)\n",
              "                    }\n",
              "                    const div = d3.select('#basic').attr('id', viz_id),\n",
              "                        div_parent = d3.select('#' + viz_id).node().parentNode\n",
              "\n",
              "                    // Link to CSS file\n",
              "                    d3.select(div_parent).insert('link')\n",
              "                        .attr('rel', 'stylesheet')\n",
              "                        .attr('type', 'text/css')\n",
              "                        .attr('href', ecco_url + 'html/styles.css')\n",
              "\n",
              "                    return viz_id\n",
              "                }\n",
              "            }\n",
              "        }, function (err) {console.log(err);}\n",
              "    )\n",
              "    // console.log('after defining basic')\n",
              "\n",
              "</script>\n",
              "<div id=\"basic\"></div>\n"
            ],
            "text/plain": [
              "<IPython.core.display.HTML object>"
            ]
          },
          "metadata": {
            "tags": []
          }
        },
        {
          "output_type": "display_data",
          "data": {
            "application/javascript": [
              "\n",
              "         requirejs(['basic', 'ecco'], function(basic, ecco){\n",
              "            const viz_id = basic.init()\n",
              "            ecco.interactiveTokensAndFactorSparklines(viz_id, {'tokens': [{'token': '[CLS]', 'token_id': 101, 'type': 'input', 'position': 0}, {'token': 'now', 'token_id': 2085, 'type': 'input', 'position': 1}, {'token': 'i', 'token_id': 1045, 'type': 'input', 'position': 2}, {'token': 'ask', 'token_id': 3198, 'type': 'input', 'position': 3}, {'token': 'you', 'token_id': 2017, 'type': 'input', 'position': 4}, {'token': ':', 'token_id': 1024, 'type': 'input', 'position': 5}, {'token': 'what', 'token_id': 2054, 'type': 'input', 'position': 6}, {'token': 'can', 'token_id': 2064, 'type': 'input', 'position': 7}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 8}, {'token': 'expected', 'token_id': 3517, 'type': 'input', 'position': 9}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 10}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 11}, {'token': 'since', 'token_id': 2144, 'type': 'input', 'position': 12}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 13}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 14}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 15}, {'token': 'being', 'token_id': 2108, 'type': 'input', 'position': 16}, {'token': 'endowed', 'token_id': 19038, 'type': 'input', 'position': 17}, {'token': 'with', 'token_id': 2007, 'type': 'input', 'position': 18}, {'token': 'strange', 'token_id': 4326, 'type': 'input', 'position': 19}, {'token': 'qualities', 'token_id': 11647, 'type': 'input', 'position': 20}, {'token': '?', 'token_id': 1029, 'type': 'input', 'position': 21}, {'token': 'shower', 'token_id': 6457, 'type': 'input', 'position': 22}, {'token': 'upon', 'token_id': 2588, 'type': 'input', 'position': 23}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 24}, {'token': 'every', 'token_id': 2296, 'type': 'input', 'position': 25}, {'token': 'earthly', 'token_id': 29520, 'type': 'input', 'position': 26}, {'token': 'blessing', 'token_id': 13301, 'type': 'input', 'position': 27}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 28}, {'token': 'drown', 'token_id': 19549, 'type': 'input', 'position': 29}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 30}, {'token': 'in', 'token_id': 1999, 'type': 'input', 'position': 31}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 32}, {'token': 'sea', 'token_id': 2712, 'type': 'input', 'position': 33}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 34}, {'token': 'happiness', 'token_id': 8404, 'type': 'input', 'position': 35}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 36}, {'token': 'so', 'token_id': 2061, 'type': 'input', 'position': 37}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 38}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 39}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 40}, {'token': 'bubbles', 'token_id': 17255, 'type': 'input', 'position': 41}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 42}, {'token': 'bliss', 'token_id': 13670, 'type': 'input', 'position': 43}, {'token': 'can', 'token_id': 2064, 'type': 'input', 'position': 44}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 45}, {'token': 'seen', 'token_id': 2464, 'type': 'input', 'position': 46}, {'token': 'on', 'token_id': 2006, 'type': 'input', 'position': 47}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 48}, {'token': 'surface', 'token_id': 3302, 'type': 'input', 'position': 49}, {'token': ';', 'token_id': 1025, 'type': 'input', 'position': 50}, {'token': 'give', 'token_id': 2507, 'type': 'input', 'position': 51}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 52}, {'token': 'economic', 'token_id': 3171, 'type': 'input', 'position': 53}, {'token': 'prosperity', 'token_id': 14165, 'type': 'input', 'position': 54}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 55}, {'token': 'such', 'token_id': 2107, 'type': 'input', 'position': 56}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 57}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 58}, {'token': 'should', 'token_id': 2323, 'type': 'input', 'position': 59}, {'token': 'have', 'token_id': 2031, 'type': 'input', 'position': 60}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 61}, {'token': 'else', 'token_id': 2842, 'type': 'input', 'position': 62}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 63}, {'token': 'do', 'token_id': 2079, 'type': 'input', 'position': 64}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 65}, {'token': 'sleep', 'token_id': 3637, 'type': 'input', 'position': 66}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 67}, {'token': 'eat', 'token_id': 4521, 'type': 'input', 'position': 68}, {'token': 'cakes', 'token_id': 22619, 'type': 'input', 'position': 69}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 70}, {'token': 'busy', 'token_id': 5697, 'type': 'input', 'position': 71}, {'token': 'himself', 'token_id': 2370, 'type': 'input', 'position': 72}, {'token': 'with', 'token_id': 2007, 'type': 'input', 'position': 73}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 74}, {'token': 'continuation', 'token_id': 13633, 'type': 'input', 'position': 75}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 76}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 77}, {'token': 'species', 'token_id': 2427, 'type': 'input', 'position': 78}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 79}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 80}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 81}, {'token': 'then', 'token_id': 2059, 'type': 'input', 'position': 82}, {'token': 'out', 'token_id': 2041, 'type': 'input', 'position': 83}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 84}, {'token': 'sheer', 'token_id': 11591, 'type': 'input', 'position': 85}, {'token': 'ing', 'token_id': 13749, 'type': 'input', 'position': 86}, {'token': '##rat', 'token_id': 8609, 'type': 'input', 'position': 87}, {'token': '##itude', 'token_id': 18679, 'type': 'input', 'position': 88}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 89}, {'token': 'sheer', 'token_id': 11591, 'type': 'input', 'position': 90}, {'token': 'spite', 'token_id': 8741, 'type': 'input', 'position': 91}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 92}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 93}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 94}, {'token': 'play', 'token_id': 2377, 'type': 'input', 'position': 95}, {'token': 'you', 'token_id': 2017, 'type': 'input', 'position': 96}, {'token': 'some', 'token_id': 2070, 'type': 'input', 'position': 97}, {'token': 'nasty', 'token_id': 11808, 'type': 'input', 'position': 98}, {'token': 'trick', 'token_id': 7577, 'type': 'input', 'position': 99}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 100}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 101}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 102}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 103}, {'token': 'risk', 'token_id': 3891, 'type': 'input', 'position': 104}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 105}, {'token': 'cakes', 'token_id': 22619, 'type': 'input', 'position': 106}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 107}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 108}, {'token': 'deliberately', 'token_id': 9969, 'type': 'input', 'position': 109}, {'token': 'desire', 'token_id': 4792, 'type': 'input', 'position': 110}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 111}, {'token': 'most', 'token_id': 2087, 'type': 'input', 'position': 112}, {'token': 'fatal', 'token_id': 10611, 'type': 'input', 'position': 113}, {'token': 'rubbish', 'token_id': 29132, 'type': 'input', 'position': 114}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 115}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 116}, {'token': 'most', 'token_id': 2087, 'type': 'input', 'position': 117}, {'token': 'une', 'token_id': 16655, 'type': 'input', 'position': 118}, {'token': '##con', 'token_id': 8663, 'type': 'input', 'position': 119}, {'token': '##omic', 'token_id': 22026, 'type': 'input', 'position': 120}, {'token': '##al', 'token_id': 2389, 'type': 'input', 'position': 121}, {'token': 'absurd', 'token_id': 18691, 'type': 'input', 'position': 122}, {'token': '##ity', 'token_id': 3012, 'type': 'input', 'position': 123}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 124}, {'token': 'simply', 'token_id': 3432, 'type': 'input', 'position': 125}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 126}, {'token': 'introduce', 'token_id': 8970, 'type': 'input', 'position': 127}, {'token': 'into', 'token_id': 2046, 'type': 'input', 'position': 128}, {'token': 'all', 'token_id': 2035, 'type': 'input', 'position': 129}, {'token': 'this', 'token_id': 2023, 'type': 'input', 'position': 130}, {'token': 'positive', 'token_id': 3893, 'type': 'input', 'position': 131}, {'token': 'good', 'token_id': 2204, 'type': 'input', 'position': 132}, {'token': 'sense', 'token_id': 3168, 'type': 'input', 'position': 133}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 134}, {'token': 'fatal', 'token_id': 10611, 'type': 'input', 'position': 135}, {'token': 'fantastic', 'token_id': 10392, 'type': 'input', 'position': 136}, {'token': 'element', 'token_id': 5783, 'type': 'input', 'position': 137}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 138}, {'token': 'it', 'token_id': 2009, 'type': 'input', 'position': 139}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 140}, {'token': 'just', 'token_id': 2074, 'type': 'input', 'position': 141}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 142}, {'token': 'fantastic', 'token_id': 10392, 'type': 'input', 'position': 143}, {'token': 'dreams', 'token_id': 5544, 'type': 'input', 'position': 144}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 145}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 146}, {'token': 'vulgar', 'token_id': 29364, 'type': 'input', 'position': 147}, {'token': 'folly', 'token_id': 26272, 'type': 'input', 'position': 148}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 149}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 150}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 151}, {'token': 'desire', 'token_id': 4792, 'type': 'input', 'position': 152}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 153}, {'token': 'retain', 'token_id': 9279, 'type': 'input', 'position': 154}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 155}, {'token': 'simply', 'token_id': 3432, 'type': 'input', 'position': 156}, {'token': 'in', 'token_id': 1999, 'type': 'input', 'position': 157}, {'token': 'order', 'token_id': 2344, 'type': 'input', 'position': 158}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 159}, {'token': 'prove', 'token_id': 6011, 'type': 'input', 'position': 160}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 161}, {'token': 'himself', 'token_id': 2370, 'type': 'input', 'position': 162}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 163}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 164}, {'token': 'as', 'token_id': 2004, 'type': 'input', 'position': 165}, {'token': 'though', 'token_id': 2295, 'type': 'input', 'position': 166}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 167}, {'token': 'were', 'token_id': 2020, 'type': 'input', 'position': 168}, {'token': 'so', 'token_id': 2061, 'type': 'input', 'position': 169}, {'token': 'necessary', 'token_id': 4072, 'type': 'input', 'position': 170}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 171}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 172}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 173}, {'token': 'men', 'token_id': 2273, 'type': 'input', 'position': 174}, {'token': 'still', 'token_id': 2145, 'type': 'input', 'position': 175}, {'token': 'are', 'token_id': 2024, 'type': 'input', 'position': 176}, {'token': 'men', 'token_id': 2273, 'type': 'input', 'position': 177}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 178}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 179}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 180}, {'token': 'keys', 'token_id': 6309, 'type': 'input', 'position': 181}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 182}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 183}, {'token': 'piano', 'token_id': 3682, 'type': 'input', 'position': 184}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 185}, {'token': 'which', 'token_id': 2029, 'type': 'input', 'position': 186}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 187}, {'token': 'laws', 'token_id': 4277, 'type': 'input', 'position': 188}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 189}, {'token': 'nature', 'token_id': 3267, 'type': 'input', 'position': 190}, {'token': 'threaten', 'token_id': 15686, 'type': 'input', 'position': 191}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 192}, {'token': 'control', 'token_id': 2491, 'type': 'input', 'position': 193}, {'token': 'so', 'token_id': 2061, 'type': 'input', 'position': 194}, {'token': 'completely', 'token_id': 3294, 'type': 'input', 'position': 195}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 196}, {'token': 'soon', 'token_id': 2574, 'type': 'input', 'position': 197}, {'token': 'one', 'token_id': 2028, 'type': 'input', 'position': 198}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 199}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 200}, {'token': 'able', 'token_id': 2583, 'type': 'input', 'position': 201}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 202}, {'token': 'desire', 'token_id': 4792, 'type': 'input', 'position': 203}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 204}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 205}, {'token': 'by', 'token_id': 2011, 'type': 'input', 'position': 206}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 207}, {'token': 'calendar', 'token_id': 8094, 'type': 'input', 'position': 208}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 209}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 210}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 211}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 212}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 213}, {'token': 'all', 'token_id': 2035, 'type': 'input', 'position': 214}, {'token': ':', 'token_id': 1024, 'type': 'input', 'position': 215}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 216}, {'token': 'if', 'token_id': 2065, 'type': 'input', 'position': 217}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 218}, {'token': 'really', 'token_id': 2428, 'type': 'input', 'position': 219}, {'token': 'were', 'token_id': 2020, 'type': 'input', 'position': 220}, {'token': 'nothing', 'token_id': 2498, 'type': 'input', 'position': 221}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 222}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 223}, {'token': 'piano', 'token_id': 3682, 'type': 'input', 'position': 224}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 225}, {'token': 'key', 'token_id': 3145, 'type': 'input', 'position': 226}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 227}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 228}, {'token': 'if', 'token_id': 2065, 'type': 'input', 'position': 229}, {'token': 'this', 'token_id': 2023, 'type': 'input', 'position': 230}, {'token': 'were', 'token_id': 2020, 'type': 'input', 'position': 231}, {'token': 'proved', 'token_id': 4928, 'type': 'input', 'position': 232}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 233}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 234}, {'token': 'by', 'token_id': 2011, 'type': 'input', 'position': 235}, {'token': 'natural', 'token_id': 3019, 'type': 'input', 'position': 236}, {'token': 'science', 'token_id': 2671, 'type': 'input', 'position': 237}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 238}, {'token': 'mathematics', 'token_id': 5597, 'type': 'input', 'position': 239}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 240}, {'token': 'even', 'token_id': 2130, 'type': 'input', 'position': 241}, {'token': 'then', 'token_id': 2059, 'type': 'input', 'position': 242}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 243}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 244}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 245}, {'token': 'become', 'token_id': 2468, 'type': 'input', 'position': 246}, {'token': 'reasonable', 'token_id': 9608, 'type': 'input', 'position': 247}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 248}, {'token': 'but', 'token_id': 2021, 'type': 'input', 'position': 249}, {'token': 'would', 'token_id': 2052, 'type': 'input', 'position': 250}, {'token': 'purposely', 'token_id': 24680, 'type': 'input', 'position': 251}, {'token': 'do', 'token_id': 2079, 'type': 'input', 'position': 252}, {'token': 'something', 'token_id': 2242, 'type': 'input', 'position': 253}, {'token': 'per', 'token_id': 2566, 'type': 'input', 'position': 254}, {'token': '##verse', 'token_id': 16070, 'type': 'input', 'position': 255}, {'token': 'out', 'token_id': 2041, 'type': 'input', 'position': 256}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 257}, {'token': 'simple', 'token_id': 3722, 'type': 'input', 'position': 258}, {'token': 'ing', 'token_id': 13749, 'type': 'input', 'position': 259}, {'token': '##rat', 'token_id': 8609, 'type': 'input', 'position': 260}, {'token': '##itude', 'token_id': 18679, 'type': 'input', 'position': 261}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 262}, {'token': 'simply', 'token_id': 3432, 'type': 'input', 'position': 263}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 264}, {'token': 'gain', 'token_id': 5114, 'type': 'input', 'position': 265}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 266}, {'token': 'point', 'token_id': 2391, 'type': 'input', 'position': 267}, {'token': '.', 'token_id': 1012, 'type': 'input', 'position': 268}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 269}, {'token': 'if', 'token_id': 2065, 'type': 'input', 'position': 270}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 271}, {'token': 'does', 'token_id': 2515, 'type': 'input', 'position': 272}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 273}, {'token': 'find', 'token_id': 2424, 'type': 'input', 'position': 274}, {'token': 'means', 'token_id': 2965, 'type': 'input', 'position': 275}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 276}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 277}, {'token': 'con', 'token_id': 9530, 'type': 'input', 'position': 278}, {'token': '##tri', 'token_id': 18886, 'type': 'input', 'position': 279}, {'token': '##ve', 'token_id': 3726, 'type': 'input', 'position': 280}, {'token': 'destruction', 'token_id': 6215, 'type': 'input', 'position': 281}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 282}, {'token': 'chaos', 'token_id': 8488, 'type': 'input', 'position': 283}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 284}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 285}, {'token': 'con', 'token_id': 9530, 'type': 'input', 'position': 286}, {'token': '##tri', 'token_id': 18886, 'type': 'input', 'position': 287}, {'token': '##ve', 'token_id': 3726, 'type': 'input', 'position': 288}, {'token': 'suffering', 'token_id': 6114, 'type': 'input', 'position': 289}, {'token': '##s', 'token_id': 2015, 'type': 'input', 'position': 290}, {'token': 'of', 'token_id': 1997, 'type': 'input', 'position': 291}, {'token': 'all', 'token_id': 2035, 'type': 'input', 'position': 292}, {'token': 'sorts', 'token_id': 11901, 'type': 'input', 'position': 293}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 294}, {'token': 'only', 'token_id': 2069, 'type': 'input', 'position': 295}, {'token': 'to', 'token_id': 2000, 'type': 'input', 'position': 296}, {'token': 'gain', 'token_id': 5114, 'type': 'input', 'position': 297}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 298}, {'token': 'point', 'token_id': 2391, 'type': 'input', 'position': 299}, {'token': '!', 'token_id': 999, 'type': 'input', 'position': 300}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 301}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 302}, {'token': 'launch', 'token_id': 4888, 'type': 'input', 'position': 303}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 304}, {'token': 'curse', 'token_id': 8364, 'type': 'input', 'position': 305}, {'token': 'upon', 'token_id': 2588, 'type': 'input', 'position': 306}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 307}, {'token': 'world', 'token_id': 2088, 'type': 'input', 'position': 308}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 309}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 310}, {'token': 'as', 'token_id': 2004, 'type': 'input', 'position': 311}, {'token': 'only', 'token_id': 2069, 'type': 'input', 'position': 312}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 313}, {'token': 'can', 'token_id': 2064, 'type': 'input', 'position': 314}, {'token': 'curse', 'token_id': 8364, 'type': 'input', 'position': 315}, {'token': '(', 'token_id': 1006, 'type': 'input', 'position': 316}, {'token': 'it', 'token_id': 2009, 'type': 'input', 'position': 317}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 318}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 319}, {'token': 'privilege', 'token_id': 14293, 'type': 'input', 'position': 320}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 321}, {'token': 'the', 'token_id': 1996, 'type': 'input', 'position': 322}, {'token': 'primary', 'token_id': 3078, 'type': 'input', 'position': 323}, {'token': 'distinction', 'token_id': 7835, 'type': 'input', 'position': 324}, {'token': 'between', 'token_id': 2090, 'type': 'input', 'position': 325}, {'token': 'him', 'token_id': 2032, 'type': 'input', 'position': 326}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 327}, {'token': 'other', 'token_id': 2060, 'type': 'input', 'position': 328}, {'token': 'animals', 'token_id': 4176, 'type': 'input', 'position': 329}, {'token': ')', 'token_id': 1007, 'type': 'input', 'position': 330}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 331}, {'token': 'may', 'token_id': 2089, 'type': 'input', 'position': 332}, {'token': 'be', 'token_id': 2022, 'type': 'input', 'position': 333}, {'token': 'by', 'token_id': 2011, 'type': 'input', 'position': 334}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 335}, {'token': 'curse', 'token_id': 8364, 'type': 'input', 'position': 336}, {'token': 'alone', 'token_id': 2894, 'type': 'input', 'position': 337}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 338}, {'token': 'will', 'token_id': 2097, 'type': 'input', 'position': 339}, {'token': 'attain', 'token_id': 18759, 'type': 'input', 'position': 340}, {'token': 'his', 'token_id': 2010, 'type': 'input', 'position': 341}, {'token': 'object', 'token_id': 4874, 'type': 'input', 'position': 342}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 343}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 344}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 345}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 346}, {'token': ',', 'token_id': 1010, 'type': 'input', 'position': 347}, {'token': 'convince', 'token_id': 8054, 'type': 'input', 'position': 348}, {'token': 'himself', 'token_id': 2370, 'type': 'input', 'position': 349}, {'token': 'that', 'token_id': 2008, 'type': 'input', 'position': 350}, {'token': 'he', 'token_id': 2002, 'type': 'input', 'position': 351}, {'token': 'is', 'token_id': 2003, 'type': 'input', 'position': 352}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 353}, {'token': 'man', 'token_id': 2158, 'type': 'input', 'position': 354}, {'token': 'and', 'token_id': 1998, 'type': 'input', 'position': 355}, {'token': 'not', 'token_id': 2025, 'type': 'input', 'position': 356}, {'token': 'a', 'token_id': 1037, 'type': 'input', 'position': 357}, {'token': 'piano', 'token_id': 3682, 'type': 'input', 'position': 358}, {'token': '-', 'token_id': 1011, 'type': 'input', 'position': 359}, {'token': 'key', 'token_id': 3145, 'type': 'input', 'position': 360}, {'token': '!', 'token_id': 999, 'type': 'input', 'position': 361}, {'token': '[SEP]', 'token_id': 102, 'type': 'input', 'position': 362}], 'factors': [[[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.028541618958115578, 0.0, 0.0, 0.0, 0.22310416400432587, 0.0, 0.029207490384578705, 0.0, 0.036597661674022675, 0.2754853069782257, 0.03844723850488663, 0.0, 0.15750515460968018, 0.0, 0.0, 0.015429740771651268, 0.0, 0.028608212247490883, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.14069005846977234, 0.28383761644363403, 0.0, 0.29421818256378174, 0.0, 0.0, 0.07312185317277908, 0.01973501406610012, 0.0, 0.08092153072357178, 0.0, 0.38905784487724304, 0.0, 0.008675224147737026, 0.03755443915724754, 0.013298568315804005, 0.18821072578430176, 0.21452313661575317, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0006759004318155348, 0.0, 0.0, 0.3944797217845917, 0.08127740770578384, 0.0234727393835783, 0.0, 0.03319210931658745, 0.0, 0.0, 0.17080441117286682, 0.0, 0.0, 0.17978939414024353, 0.24911633133888245, 0.0, 0.3258049488067627, 0.0, 0.0, 0.0, 0.05826786532998085, 0.0, 0.052349988371133804, 0.037037454545497894, 0.25566497445106506, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.011098446324467659, 0.0, 0.04578769952058792, 0.03496326506137848, 0.13426686823368073, 0.17886628210544586, 0.0, 0.01592346280813217, 0.17522872984409332, 0.06433256715536118, 0.09689119458198547, 0.06041558086872101, 0.0, 0.06338722258806229, 0.0, 0.1270107626914978, 0.03371873497962952, 0.0, 0.0, 0.2305900752544403, 0.06607727706432343, 0.0, 0.0, 0.0, 0.2403196543455124, 0.08194167912006378, 0.0, 0.0, 0.0, 0.058695994317531586, 0.0, 0.04704663157463074, 0.0452401265501976, 0.0006494263070635498, 0.4986856281757355, 0.0, 0.1560281664133072, 0.048960670828819275, 0.0781577005982399, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.00751051539555192, 0.4122296869754791, 0.026076484471559525, 0.02157721295952797, 0.011003565974533558, 0.25730830430984497, 0.09951774030923843, 0.46481359004974365, 0.01260943990200758, 0.4748499393463135, 0.04320550709962845, 0.3761470913887024, 0.3347848653793335, 0.18308092653751373, 0.07002729177474976, 0.032676272094249725, 0.08393120020627975, 0.07212508469820023, 0.0, 0.24115897715091705, 0.2450556606054306, 0.0, 0.0, 0.0, 0.012279599905014038, 0.0, 0.07012282311916351, 0.10685691237449646, 0.15938881039619446, 0.0, 0.2860215902328491, 0.2622896730899811, 0.0, 0.0, 0.16036897897720337, 0.2745399475097656, 0.028729084879159927, 0.3300488591194153, 0.016992956399917603, 0.0, 0.4799092411994934, 0.02834196574985981, 0.09102839231491089, 0.003676994936540723, 0.04251979663968086, 0.0, 0.14645470678806305, 0.0, 0.05823362246155739, 0.0, 0.3822646141052246, 0.0, 0.0, 0.0, 0.20396767556667328, 0.15914303064346313, 0.0, 0.0007690476486459374, 0.045341648161411285, 0.0, 0.0, 0.1265696883201599, 0.0059166960418224335, 0.008281939662992954, 0.0, 0.07540985941886902, 0.01253293827176094, 0.006469264160841703, 0.0829773098230362, 0.013526275753974915, 0.11072701960802078, 0.3144611418247223, 0.010213210247457027, 0.3455168306827545, 0.024525774642825127, 0.06808377057313919, 0.0, 0.1188996359705925, 0.14854934811592102, 0.10743876546621323, 0.006147393025457859, 0.4017220437526703, 0.038158219307661057, 0.2517082393169403, 0.0, 0.0, 0.14792083203792572, 0.0, 0.0, 0.0, 0.039367880672216415, 0.0, 0.0, 0.08089730888605118, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.031184837222099304, 0.0, 0.0, 0.0, 0.0, 0.21393969655036926, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.4056781530380249, 0.0030847990419715643, 0.019671233370900154, 0.017587436363101006, 0.09640135616064072, 0.165996253490448, 0.11629423499107361, 0.05160932242870331, 0.08398335427045822, 0.1777234971523285, 0.025006862357258797, 0.030049435794353485, 0.042757872492074966, 0.0, 0.0, 0.0, 0.02080453932285309, 0.0, 0.10435300320386887, 0.0, 0.0, 0.0, 0.0, 0.0010606350842863321, 0.02092558704316616, 0.0, 0.029311703518033028, 0.2806225121021271, 0.036244798451662064, 0.0, 0.0, 0.06183401122689247, 0.4278770983219147, 0.018734540790319443, 0.06333345174789429, 0.041842520236968994, 0.002943664789199829, 0.005049801431596279, 0.0, 0.007930781692266464, 0.3421655297279358, 0.008384793996810913, 0.08435777574777603, 0.21773359179496765, 0.04037986695766449, 0.014299030415713787, 0.14344127476215363, 0.14764238893985748, 0.050638798624277115, 0.0, 0.0, 0.0, 0.035793352872133255, 0.02770944871008396, 0.0, 0.0, 0.001144355395808816, 0.0, 0.14809949696063995, 0.023056823760271072, 0.0128396051004529, 0.07561811804771423, 0.015213013626635075, 0.14149336516857147, 0.12553788721561432, 0.028786489740014076, 0.08626184612512589, 0.04413020983338356, 0.041172027587890625, 0.07417881488800049, 0.258187472820282, 0.04871436581015587, 0.004952732939273119, 0.00876505859196186, 0.0053610545583069324, 0.0, 0.0, 0.006432246416807175, 0.00142806232906878, 0.2430177628993988, 0.26666173338890076, 0.0, 0.016576973721385002, 0.0, 0.0, 0.016165299341082573, 0.041472285985946655, 0.047304827719926834, 0.1072264015674591, 0.31570345163345337, 0.06871267408132553, 0.23543114960193634, 0.25012439489364624, 0.3708629906177521, 0.03608616814017296, 0.3990066349506378, 0.050383925437927246, 0.06338289380073547, 0.08767516911029816], [0.04236602038145065, 0.0, 0.0, 0.0, 0.024533240124583244, 0.0937662348151207, 0.038038115948438644, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0589006207883358, 0.0, 0.0, 0.0, 0.005375897977501154, 0.0, 0.0, 0.7845412492752075, 0.0, 0.0010887091048061848, 0.09760920703411102, 0.0, 0.0, 0.004492446314543486, 0.0, 0.7581107020378113, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.12129883468151093, 0.0, 0.0, 0.0, 0.0, 0.7755832076072693, 0.0, 0.0, 0.0, 0.0, 0.03448057919740677, 0.0, 0.0, 0.0, 0.09625136107206345, 0.07570870965719223, 0.0, 0.7686697244644165, 0.0, 0.0, 0.22702248394489288, 0.0, 0.0, 0.08968261629343033, 0.1806446611881256, 0.0, 0.07151230424642563, 0.0486149862408638, 0.017250604927539825, 0.9386603832244873, 0.41944169998168945, 0.0018328260630369186, 0.2092140018939972, 0.18415187299251556, 0.34775441884994507, 0.0, 0.005395142361521721, 0.028343310579657555, 0.020246874541044235, 1.1134061813354492, 0.0, 0.1182924211025238, 1.1241204738616943, 0.1756940335035324, 0.22318153083324432, 0.14414888620376587, 0.30680716037750244, 0.2244323194026947, 0.049234144389629364, 0.0538158044219017, 0.5679062008857727, 0.18726690113544464, 0.15591922402381897, 0.07758865505456924, 0.026058221235871315, 0.22097933292388916, 0.047648247331380844, 0.5182508826255798, 0.2435416579246521, 0.0, 0.052449390292167664, 0.42126932740211487, 0.2946231961250305, 0.03396598622202873, 0.021467337384819984, 1.1318176984786987, 0.4169756770133972, 0.28207841515541077, 0.04147921875119209, 0.0, 0.00880424864590168, 0.0641729012131691, 0.0013697510585188866, 0.11123137176036835, 1.0308698415756226, 0.021850422024726868, 0.09890375286340714, 0.027777934446930885, 0.10228828340768814, 0.08208261430263519, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.3071785271167755, 0.0716196671128273, 0.0, 0.0, 0.0, 0.0, 0.0, 0.6428532600402832, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.6506859064102173, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.2143602967262268, 0.008186949416995049, 0.15183836221694946, 0.0, 0.06958239525556564, 0.058971844613552094, 0.0, 0.7120581865310669, 0.01960190199315548, 0.08349806070327759, 0.0, 0.044615086168050766, 0.0, 0.0, 0.0, 0.0, 0.0028218915686011314, 0.0, 0.008456981740891933, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.07979638874530792, 0.0, 0.12469874322414398, 0.0, 0.4165818691253662, 0.27908438444137573, 0.09501433372497559, 0.057257696986198425, 0.0, 0.058090753853321075, 0.18074890971183777, 0.0, 0.07515320181846619, 0.014847307465970516, 0.0, 0.0, 0.0, 0.007006906438618898, 0.03288116678595543, 0.0, 0.0, 0.0, 0.6790542006492615, 0.0, 0.01926548033952713, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.12061282247304916, 0.0, 0.5691055655479431, 0.0, 0.004479706287384033, 0.0, 0.0, 0.0, 0.0, 0.0, 0.6026819944381714, 0.02279266156256199, 0.0, 0.0, 0.1575171947479248, 0.00520860543474555, 0.0, 0.0, 0.10437875241041183, 0.18211506307125092, 0.020262394100427628, 0.0, 0.0, 0.0, 0.8326303958892822, 0.0, 0.0678999200463295, 0.022538725286722183, 0.10942643880844116, 0.10582619160413742, 0.4593009352684021, 0.3077109754085541, 0.13145366311073303, 0.06361006945371628, 0.02157345972955227, 0.007956285960972309, 0.017684943974018097, 0.05347757413983345, 0.052177637815475464, 0.0, 0.05238852649927139, 0.02554011531174183, 0.018918054178357124, 0.0, 0.3751760721206665, 0.07060331106185913, 0.9203827977180481, 0.0505085214972496, 0.06508646160364151, 0.05078040435910225, 0.06581264734268188, 0.02666914463043213, 0.23582524061203003, 0.2667997479438782, 0.1591973602771759, 0.030319560319185257, 0.964817225933075, 0.15895693004131317, 0.16928280889987946, 0.05087180435657501, 0.12493930757045746, 0.09258057177066803, 0.21245066821575165, 0.17839130759239197, 0.06309126317501068, 0.030818959698081017, 0.1304795891046524, 0.005784690845757723, 0.0, 0.16835175454616547, 0.03431829437613487, 0.6719427108764648, 0.2025652676820755, 0.040789660066366196, 0.0, 0.014416398480534554, 0.00791070144623518, 0.0007294972892850637, 0.2096329927444458, 0.1583673357963562, 0.11904836446046829, 0.037352629005908966, 0.021198954433202744, 0.7995311617851257, 0.25425320863723755, 0.007923825643956661, 0.006964861415326595, 0.052628934383392334, 0.028679152950644493, 0.21420226991176605, 0.05905824527144432, 0.0, 0.06042145565152168, 0.7334484457969666, 0.005355647765100002, 0.0, 0.0, 0.0, 0.0, 0.023577505722641945, 0.007744550704956055, 0.0, 0.0, 0.009691658429801464, 0.008310608565807343, 0.12899751961231232, 0.05766744166612625, 0.0390593446791172, 0.11279646307229996, 0.8268099427223206, 0.0, 0.0035711934324353933, 0.0782260000705719, 0.03330814093351364, 0.0797918364405632, 0.047553226351737976, 0.0050981962122023106, 0.14188091456890106, 0.0, 0.007429210934787989, 0.0, 0.0, 0.0, 0.06307712197303772, 0.1952744722366333], [0.0, 0.0623689666390419, 0.10984040796756744, 0.0, 0.020864510908722878, 0.0, 0.0, 0.0, 0.02318285033106804, 0.0, 0.0, 0.05373864248394966, 0.0, 0.7086107134819031, 0.003732685698196292, 0.0, 0.0, 0.0, 0.0023276193533092737, 0.0, 0.0, 0.011334463953971863, 0.0, 0.0, 0.7491614818572998, 0.0, 0.0, 0.0, 0.0, 0.0, 0.7581678628921509, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.008398931473493576, 0.0, 0.0, 0.010123800486326218, 0.0, 0.00535569665953517, 0.006015108432620764, 0.7334657907485962, 0.0, 0.0, 0.0, 0.0, 0.0, 0.7125415802001953, 0.0, 0.016269396990537643, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.4974946081638336, 0.028199436143040657, 0.021769924089312553, 0.0005203073960728943, 0.0, 0.8755311965942383, 0.0337875671684742, 0.0, 0.00734661053866148, 0.0, 0.02657896839082241, 0.02698284201323986, 0.0, 0.0, 0.0, 0.00018957209249492735, 0.0, 0.0, 0.0, 0.0, 0.0, 0.10236585885286331, 0.0, 0.025884894654154778, 0.04660238325595856, 0.03585432842373848, 0.0, 0.0, 0.011542707681655884, 0.7347857356071472, 0.0, 0.0, 0.0, 0.859626293182373, 0.0, 0.03373583033680916, 0.0011698558228090405, 0.0, 0.0, 0.02601590007543564, 0.023854564875364304, 0.0, 0.0, 0.0, 0.024155253544449806, 0.024732280522584915, 0.0, 0.0, 0.0, 0.014327178709208965, 0.0, 0.0011814447352662683, 0.0, 0.0, 0.0, 0.0, 0.03585640341043472, 0.022499438375234604, 0.05043653026223183, 0.0, 0.0, 0.0, 0.7310752272605896, 0.0, 0.0, 0.0, 0.0, 0.03207483887672424, 0.0, 0.0, 0.7663383483886719, 0.0, 0.0, 0.0, 0.7687757015228271, 0.0, 0.0, 0.0, 0.7125453352928162, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.4400694668292999, 0.0, 0.0, 0.014937100000679493, 0.0, 0.0, 0.014219004660844803, 0.012859627604484558, 0.0, 0.0, 0.0, 0.0, 0.005495951045304537, 0.01614725962281227, 0.013478315435349941, 0.007402570452541113, 0.0, 0.0, 0.0, 0.0, 0.0, 0.016622943803668022, 0.0, 0.0, 0.018029427155852318, 0.021389944478869438, 0.01568032242357731, 0.0022447588853538036, 0.0, 0.0, 0.0, 0.004766409285366535, 0.0, 0.0, 0.0, 0.002616088604554534, 0.009789844043552876, 0.0, 0.03626946359872818, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.013952363282442093, 7.943853415781632e-05, 0.008447842672467232, 0.0, 0.0, 0.020365267992019653, 0.0, 0.019427521154284477, 0.006453594192862511, 0.0, 0.001883653225377202, 0.10547522455453873, 0.019050896167755127, 0.01464277133345604, 0.0, 0.009207678027451038, 0.02450081892311573, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0027734555769711733, 0.051019344478845596, 0.035882603377103806, 0.0, 0.0, 0.690000057220459, 0.0, 0.0, 0.0, 0.017346132546663284, 0.0, 0.0, 0.0, 0.027825521305203438, 0.6528735160827637, 0.0, 0.0, 0.023638509213924408, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0172742772847414, 0.0, 0.0, 0.019128946587443352, 0.0, 0.0, 0.0, 0.0013698646798729897, 0.0, 0.0, 0.0, 0.0, 0.031044209375977516, 0.7930572628974915, 0.0072238571010529995, 0.019919946789741516, 0.019982963800430298, 0.008627946488559246, 0.7209851741790771, 0.008721258491277695, 0.0007981513044796884, 0.0066094715148210526, 0.009096751920878887, 0.7126576900482178, 0.0001906895195133984, 0.0, 0.0, 0.0017786123789846897, 0.0, 0.04798674210906029, 0.02939654141664505, 0.0039509497582912445, 0.0, 0.0, 0.0, 0.0, 0.015041498467326164, 0.05085492134094238, 0.008233719505369663, 0.04524822533130646, 0.00455909688025713, 0.007748471572995186, 0.01967952959239483, 0.0, 0.044190745800733566, 0.7718715667724609, 0.02350194752216339, 0.033666495233774185, 0.6960774064064026, 0.0, 0.002737725619226694, 0.04922950640320778, 0.009850118309259415, 0.0, 0.026463016867637634, 0.003480838844552636, 0.004756673704832792, 0.0298406220972538, 0.0314183235168457, 0.02501346543431282, 0.10175913572311401, 0.02574344165623188, 0.01808786205947399, 0.03709818050265312, 0.08406389504671097, 0.04783415049314499, 0.8019759058952332, 0.017880108207464218, 0.0, 0.037200577557086945, 0.002754626562818885, 6.943570770090446e-05, 0.01127912662923336, 0.7099670171737671, 0.02243689075112343, 0.057657331228256226, 0.0, 0.030309835448861122, 0.013849770650267601, 0.0, 0.051657989621162415, 0.00833910796791315, 0.817371129989624, 0.024403100833296776, 0.02328767441213131, 0.6936573386192322, 0.0, 0.0, 0.8181427121162415, 0.0016686791786924005, 0.0, 0.0084972670301795, 0.020096246153116226, 0.045406803488731384, 0.0, 0.0, 0.43257805705070496, 0.02630072645843029, 0.7070968151092529, 0.05574337765574455, 0.044062208384275436, 0.09604468196630478, 0.022229034453630447, 0.007647127378731966, 0.02666332572698593, 0.0, 0.0, 0.0023346375674009323, 0.03103758953511715, 0.020653706043958664], [0.0, 0.0, 0.02906692959368229, 0.0015397268580272794, 0.028023788705468178, 0.0, 0.0, 0.37211892008781433, 0.07821860909461975, 0.02819216437637806, 0.0, 0.0, 0.0, 0.0, 0.2400110960006714, 0.0, 0.017751209437847137, 0.0, 0.0, 0.0, 0.0, 0.005179984029382467, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.42133304476737976, 0.0959998071193695, 0.0, 0.0, 0.0, 0.0, 0.0, 0.01796516217291355, 0.0, 0.01562756672501564, 0.0, 0.0, 0.0, 0.0, 0.0, 0.2400791198015213, 0.14098778367042542, 0.0, 0.020396051928400993, 0.028765780851244926, 0.1295427531003952, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.021801268681883812, 0.011100408621132374, 0.0, 0.014712686650454998, 0.0, 0.04460911452770233, 0.0, 0.01785958930850029, 0.0, 0.0059055485762655735, 0.0072152139618992805, 0.0, 0.0, 0.0, 0.0, 0.0, 0.010323712602257729, 0.0, 0.008461558260023594, 0.0, 0.005409222561866045, 0.4893239140510559, 0.023959973827004433, 0.05855369195342064, 0.01134552527219057, 0.004200206138193607, 0.0, 0.008101549930870533, 0.02753537707030773, 0.5156987905502319, 0.0, 0.032415471971035004, 0.014721131883561611, 0.00735106086358428, 0.018078867346048355, 0.5095927715301514, 0.0001305699406657368, 0.01702805981040001, 0.002448341343551874, 0.008525174111127853, 0.00034692007466219366, 0.0, 0.0, 0.009422242641448975, 0.015471420250833035, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0014697526348754764, 0.0, 0.0, 0.025844411924481392, 0.0, 0.0, 0.0011514524230733514, 0.0, 0.0, 0.0023971195332705975, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.21510756015777588, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.5036901831626892, 0.0241196658462286, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.01781037263572216, 0.018179066479206085, 0.0, 0.13041362166404724, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.24607117474079132, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0008296606247313321, 0.0, 0.003929938655346632, 0.0, 0.0, 0.0, 0.0, 0.0, 0.01201612874865532, 0.035537827759981155, 0.04286246746778488, 0.5836538076400757, 0.10616301745176315, 0.04409361630678177, 0.03468123823404312, 0.01445070281624794, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.27943548560142517, 0.0, 0.0, 0.0, 0.0, 0.023361559957265854, 0.0, 0.006648194510489702, 0.13689729571342468, 0.0, 0.0, 0.0, 0.0, 0.0, 0.00047765724593773484, 0.0, 0.0, 0.03477681800723076, 0.01034497655928135, 0.15519949793815613, 0.0269690603017807, 0.02717704512178898, 0.004388871602714062, 0.0, 0.0288776233792305, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0033190089743584394, 0.008910758420825005, 0.49587494134902954, 0.011824099346995354, 0.020510230213403702, 0.004966647829860449, 0.0, 0.0, 0.43113136291503906, 0.0, 0.1091500073671341, 0.0, 0.0, 0.0, 0.0, 0.004135582130402327, 0.0, 0.0, 0.0, 0.00042853550985455513, 0.0, 0.0, 0.027569202706217766, 0.0, 0.0, 0.0, 0.0, 0.0, 0.021105360239744186, 0.003376639448106289, 0.1866799145936966, 0.01542885135859251, 0.04055335372686386, 0.12870937585830688, 0.04060012474656105, 0.5677175521850586, 0.02272471971809864, 0.0005701050395146012, 0.014645484276115894, 0.015350966714322567, 0.013457875698804855, 0.0012985547073185444, 0.006570965982973576, 0.5300905108451843, 0.008396769873797894, 0.0, 0.0, 0.013569450005888939, 0.029684726148843765, 0.014508522115647793, 0.022102918475866318, 0.005732101853936911, 0.022455373778939247, 0.018085747957229614, 0.057291071861982346, 0.00560876727104187, 0.014261598698794842, 0.005123268347233534, 0.04400700330734253, 0.019552627578377724, 0.5039699077606201, 0.005331248510628939, 0.0016442928463220596, 0.0, 0.0, 0.0, 0.0, 0.0, 0.006709141656756401, 0.03226436302065849, 0.005138393025845289, 0.012451334856450558, 0.37855780124664307, 0.008363142609596252, 0.027791576460003853, 0.027572480961680412, 0.23690840601921082, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.024124573916196823, 0.007416207809001207, 0.26125800609588623, 0.0978545993566513, 0.0, 0.0, 0.004877519328147173, 0.0, 0.012091649696230888, 0.5093688368797302, 0.0, 0.0012282375246286392, 0.0, 0.0, 0.0, 0.0, 0.22785480320453644, 0.0, 0.0, 0.0, 0.008162331767380238, 0.002241037553176284, 0.23196177184581757, 0.009331494569778442, 0.0, 0.0008794435416348279, 0.0, 0.0, 0.0, 0.0, 0.005435294937342405, 0.02742750197649002, 0.0061502461321651936], [0.0, 0.0, 0.0, 0.0, 0.0, 0.048184823244810104, 0.04928666353225708, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.04167475923895836, 0.0, 0.04311520978808403, 0.08065023273229599, 0.082778699696064, 0.0, 0.026611141860485077, 0.02394743077456951, 0.04908033460378647, 0.060802944004535675, 1.1624730825424194, 0.02236339822411537, 0.004043303430080414, 0.0, 0.04037320241332054, 0.05067243054509163, 0.01632677949965, 0.011595563031733036, 0.01203630305826664, 0.0359383299946785, 0.06284266710281372, 0.0, 0.021414749324321747, 0.0, 0.0008154580718837678, 0.0, 0.0, 0.0013825593050569296, 0.01345720887184143, 1.1837332248687744, 0.035604268312454224, 0.004293769132345915, 0.05607450753450394, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0028066353406757116, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.007377841509878635, 0.027321044355630875, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.05738873779773712, 0.0722557082772255, 0.0, 0.0019681837875396013, 0.056797463446855545, 0.10712707042694092, 0.07342537492513657, 0.0, 0.0, 0.0, 0.008078817278146744, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.025195352733135223, 0.07154683768749237, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.04126133397221565, 0.06963863968849182, 0.0858437791466713, 0.0402136892080307, 0.025499489158391953, 0.0, 0.0, 0.0554615817964077, 0.034096501767635345, 0.0, 0.0, 1.0888431072235107, 0.016277385875582695, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0012183341896161437, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0051433551125228405, 0.0008370522991754115, 0.9975261688232422, 0.0, 0.005141003523021936, 0.0, 0.0, 0.0, 0.9991357922554016, 0.0, 0.005605100188404322, 0.054142702370882034, 0.020458495244383812, 0.08586631715297699, 0.030038703233003616, 0.09560459852218628, 0.0, 0.054092783480882645, 0.01141168363392353, 0.0, 0.0, 0.11145970225334167, 0.06837165355682373, 0.010301865637302399, 0.0, 0.0, 0.0, 0.0, 0.026870351284742355, 0.03968645632266998, 0.032274745404720306, 1.1058210134506226, 0.034342050552368164, 0.07325105369091034, 0.025523580610752106, 0.037414610385894775, 0.0, 0.0, 0.0, 0.0011790810385718942, 0.02391350083053112, 0.028173936530947685, 0.1191207766532898, 0.003743437584489584, 0.11594471335411072, 0.11416929215192795, 1.1470160484313965, 0.15947645902633667, 0.09941170364618301, 0.13131551444530487, 0.17811089754104614, 0.018339969217777252, 0.12860937416553497, 0.049386654049158096, 0.053377483040094376, 0.061710819602012634, 0.03731834515929222, 0.062215156853199005, 0.05643605440855026, 0.0010943091474473476, 0.07371684163808823, 0.018459172919392586, 0.06663674116134644, 0.0, 0.05945347994565964, 0.10370844602584839, 0.01484723575413227, 0.007736898027360439, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.011897914111614227, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0006621906068176031, 0.07159943878650665, 0.01380082219839096, 0.0, 0.023744067177176476, 0.03599010407924652, 0.007436989340931177, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.010098487138748169, 0.00157481140922755, 0.03992098942399025, 0.005973822437226772, 0.006374642252922058, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.015680383890867233, 0.026253020390868187, 0.06633942574262619, 0.0, 0.0007072379812598228, 0.0, 0.0, 0.0, 0.0, 0.0048070428892970085, 0.023059403523802757, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.006997520569711924, 0.02359355241060257, 0.0, 0.013903496786952019, 0.05432671681046486, 0.021741772070527077, 0.01715344376862049, 0.005208494607359171, 0.0, 0.028456300497055054, 0.050166185945272446, 0.06660249829292297, 0.022164953872561455, 0.004767030477523804, 0.006379511673003435, 0.05137840658426285, 0.004511110484600067, 0.00799123290926218, 0.07655484974384308, 0.024628212675452232, 0.06608196347951889, 0.04333582520484924, 0.01042183954268694, 0.04050707817077637, 0.017963729798793793, 0.007768821902573109, 0.010116185061633587, 0.0, 0.010526016354560852, 0.008432244881987572, 0.018253175541758537, 0.01760711334645748, 0.0, 0.010427801869809628, 0.02039371430873871, 0.024214234203100204, 0.046383537352085114, 0.09394165128469467, 1.0922455787658691, 0.13010762631893158, 0.06778586655855179, 0.011580941267311573, 0.04963597655296326, 1.0372273921966553, 0.06399155408143997, 0.09652145206928253, 0.022515125572681427, 0.0, 0.02278382144868374, 0.0, 0.0, 0.0, 0.0, 0.0, 0.022972719743847847, 0.0], [0.07862504571676254, 0.04095939174294472, 0.0, 0.13980524241924286, 0.0, 0.017231091856956482, 0.0, 0.0, 0.02609427087008953, 0.17494404315948486, 0.0, 0.2192271649837494, 0.04146315157413483, 0.0, 0.0, 0.0, 0.07373279333114624, 0.09558670222759247, 0.0, 0.15221533179283142, 0.22014857828617096, 0.0033334088511765003, 0.11493285000324249, 0.12765203416347504, 0.0, 0.04544748365879059, 0.13506582379341125, 0.10178375244140625, 0.0, 0.12064949423074722, 0.0, 0.0, 0.0, 0.15733100473880768, 0.0, 0.15888768434524536, 0.0, 0.0, 0.0, 0.0715259537100792, 0.0, 0.16139207780361176, 0.0, 0.15422026813030243, 0.0077488780952990055, 0.059906020760536194, 0.16792145371437073, 0.03665940836071968, 0.0, 0.11299426108598709, 0.022640584036707878, 0.11838330328464508, 0.0, 0.17040790617465973, 0.14393456280231476, 0.0, 0.006234367843717337, 0.0, 0.0, 0.014501912519335747, 0.024507585912942886, 0.04031326249241829, 0.1371138095855713, 0.0, 0.0, 0.0, 0.14598219096660614, 0.0, 0.180324524641037, 0.17987532913684845, 0.0, 0.14082801342010498, 0.0929936021566391, 0.0026469440199434757, 0.0, 0.13741105794906616, 0.0, 0.0, 0.13659340143203735, 0.0, 0.0, 0.0, 0.07148640602827072, 0.20518219470977783, 0.0, 0.18835897743701935, 0.2337409406900406, 0.11433897912502289, 0.10238198190927505, 0.0, 0.2067520022392273, 0.1334865540266037, 0.0, 0.31270888447761536, 0.0, 0.20886169373989105, 0.07419191300868988, 0.07741700857877731, 0.23291753232479095, 0.156042218208313, 0.0527258925139904, 0.0046903579495847225, 0.0, 0.05936139449477196, 0.26392489671707153, 0.01758374646306038, 0.23641322553157806, 0.03120744787156582, 0.0, 0.41107237339019775, 0.36463993787765503, 0.06936340034008026, 0.17014279961585999, 0.24576231837272644, 0.18501102924346924, 0.029679441824555397, 0.05441775918006897, 0.17302978038787842, 0.24135196208953857, 0.2926924526691437, 0.17387616634368896, 0.20793478190898895, 0.30890482664108276, 0.17647825181484222, 0.02856871299445629, 0.23859237134456635, 0.009351425804197788, 0.30474239587783813, 0.13303211331367493, 0.13367560505867004, 0.03552740439772606, 0.18107500672340393, 0.216928631067276, 0.1411910355091095, 0.0, 0.14130018651485443, 0.1740390956401825, 0.08941357582807541, 0.0, 0.0, 0.0, 0.08458726108074188, 0.0, 0.18674954771995544, 0.20918093621730804, 0.0, 0.0, 0.15424445271492004, 0.1406252384185791, 0.0, 0.0, 0.0, 0.22990292310714722, 0.0, 0.1810843050479889, 0.0, 0.17135737836360931, 0.0, 0.10468241572380066, 0.0, 0.19236482679843903, 0.0, 0.10726428031921387, 0.0, 0.0, 0.04014153406023979, 0.06724673509597778, 0.0, 0.008141610771417618, 0.0, 0.22207552194595337, 0.022029131650924683, 0.019150516018271446, 0.002510592108592391, 0.2672429084777832, 0.10241331905126572, 0.013542121276259422, 0.2564491033554077, 0.0, 0.0, 0.0, 0.15335369110107422, 0.0, 0.0, 0.1656622439622879, 0.0, 0.02820942923426628, 0.0, 0.19753161072731018, 0.0024631209671497345, 0.20430871844291687, 0.1646418571472168, 0.0, 0.15713509917259216, 0.010014524683356285, 0.22188429534435272, 0.028551436960697174, 0.21837638318538666, 0.100087009370327, 0.0, 0.0986768901348114, 0.24639040231704712, 0.0, 0.26363661885261536, 0.07654125988483429, 0.013119874522089958, 0.04904725030064583, 0.0, 0.13251732289791107, 0.0, 0.0, 0.0, 0.014600449241697788, 0.00753901107236743, 0.10172561556100845, 0.0889170914888382, 0.0, 0.013294371776282787, 0.31526413559913635, 0.2077929973602295, 0.05536707118153572, 0.0932963564991951, 0.010804734192788601, 0.015249092131853104, 0.18070052564144135, 0.0, 0.16239435970783234, 0.0, 0.002355793258175254, 0.013947887346148491, 0.01277927029877901, 0.033514369279146194, 0.205729678273201, 0.0, 0.032341551035642624, 0.018713725730776787, 0.14220133423805237, 0.20807315409183502, 0.0, 0.1841663122177124, 0.0, 0.0, 0.06032080203294754, 0.0, 0.0, 0.03877466917037964, 0.18258903920650482, 0.1239098608493805, 0.0, 0.0, 0.0, 0.26126915216445923, 0.05076057091355324, 0.07782949507236481, 0.19104762375354767, 0.15902741253376007, 0.19326406717300415, 0.0, 0.2019384503364563, 0.20581287145614624, 0.1021643728017807, 0.09196008741855621, 0.0, 0.18395304679870605, 0.0, 0.2740941345691681, 0.006882257293909788, 0.19478198885917664, 0.03581788390874863, 0.0, 0.03405500948429108, 0.015476909466087818, 0.07087676227092743, 0.04344075545668602, 0.18528692424297333, 0.13939394056797028, 0.034006088972091675, 0.02219918742775917, 0.23250243067741394, 0.22255271673202515, 0.1895916908979416, 0.23982961475849152, 0.026967301964759827, 0.179177388548851, 0.015812058001756668, 0.020410073921084404, 0.24461664259433746, 0.2467690408229828, 0.2054046243429184, 0.23214542865753174, 0.16360267996788025, 0.030560117214918137, 0.13177649676799774, 0.17805838584899902, 0.020977120846509933, 0.13872262835502625, 0.006238235160708427, 0.2668364346027374, 0.03505358472466469, 0.19531089067459106, 0.1328088343143463, 0.039796385914087296, 0.0061940401792526245, 0.20708246529102325, 0.05008048191666603, 0.16793853044509888, 0.19231832027435303, 0.06141423061490059, 0.18372614681720734, 0.02400314435362816, 0.03462210297584534, 0.05701696127653122, 0.12311185896396637, 0.28255051374435425, 0.056193362921476364, 0.15525949001312256, 0.042938146740198135, 0.055803973227739334, 0.020409850403666496, 0.0, 0.12352040410041809, 0.0, 0.010867093689739704, 0.18529264628887177, 0.17495954036712646, 0.11876034736633301, 0.04296005517244339, 0.01787721924483776, 0.09072454273700714, 0.1455802172422409, 0.07593853026628494, 0.0, 0.050851915031671524, 0.10490082949399948, 0.05664347857236862, 0.0, 0.13012854754924774, 0.13471414148807526, 0.03373965620994568, 0.007624610792845488, 0.21424159407615662, 0.016923679038882256, 0.15462243556976318, 0.022454800084233284, 0.029164649546146393, 0.0028351147193461657, 0.034146420657634735, 0.0, 0.1849389225244522, 0.08793838322162628, 0.0, 0.012006609700620174, 0.020893791690468788, 0.04800542816519737, 0.28098440170288086, 0.0277011226862669, 0.038771845400333405, 0.04978599771857262, 0.16268318891525269, 0.033957455307245255, 0.1558195948600769, 0.12674564123153687, 0.11860597878694534], [0.0982883870601654, 0.5340249538421631, 0.738186776638031, 0.40713733434677124, 0.8283950090408325, 0.8007810115814209, 0.6431899070739746, 0.5397539138793945, 0.7855054140090942, 0.3358650803565979, 0.718144953250885, 0.4132246971130371, 0.6410452723503113, 0.5933405756950378, 0.74574875831604, 0.656360387802124, 0.5526263117790222, 0.3048500120639801, 0.670319139957428, 0.3717363178730011, 0.29089707136154175, 0.6462834477424622, 0.2030324637889862, 0.3828265964984894, 0.6081555485725403, 0.46861204504966736, 0.26100093126296997, 0.21147488057613373, 0.6158074736595154, 0.23247620463371277, 0.5794466733932495, 0.6635277271270752, 0.5471776127815247, 0.18093708157539368, 0.5508853197097778, 0.24839064478874207, 0.5176886320114136, 0.4194605350494385, 0.2759794294834137, 0.21010734140872955, 0.3542082607746124, 0.10702385753393173, 0.36347073316574097, 0.13125605881214142, 0.24170063436031342, 0.4439973533153534, 0.1409648060798645, 0.21532349288463593, 0.3051968216896057, 0.11314985901117325, 0.30160510540008545, 0.15114420652389526, 0.19773638248443604, 0.03965117037296295, 0.10069312900304794, 0.21601912379264832, 0.13547512888908386, 0.0424613356590271, 0.12196413427591324, 0.06569591164588928, 0.20195570588111877, 0.03027387522161007, 0.0, 0.06946945190429688, 0.06802348047494888, 0.06239573657512665, 0.0, 0.04408881813287735, 0.0, 0.0, 0.01943124830722809, 0.0, 0.0, 0.06235673278570175, 0.030763396993279457, 0.0, 0.023968055844306946, 0.008197680115699768, 0.0, 0.0, 0.018460718914866447, 0.0, 0.037986088544130325, 0.011772018857300282, 0.06163909658789635, 0.0, 0.0, 0.0, 0.0, 0.021495865657925606, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.11111224442720413, 0.004799962043762207, 0.0, 0.0, 0.00035920320078730583, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.011667098850011826, 0.0, 0.0, 0.0, 0.003006921149790287, 0.016195785254240036, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.06246093660593033, 0.4286973774433136, 0.22655655443668365, 0.42410197854042053, 0.3109135031700134, 0.6399455666542053, 0.29712948203086853, 0.281459242105484, 0.4038723111152649, 0.7972707748413086, 0.7180702090263367, 0.7749224305152893, 0.5694721341133118, 0.6188063025474548, 0.2674895226955414, 0.26059848070144653, 0.6030727028846741, 0.5382211208343506, 0.21823784708976746, 0.1553782969713211, 0.3966084420681, 0.49027132987976074, 0.2686154544353485, 0.1845513880252838, 0.37841832637786865, 0.10731679201126099, 0.4023453891277313, 0.144449844956398, 0.377566397190094, 0.10183250904083252, 0.25076985359191895, 0.06929437071084976, 0.21660280227661133, 0.06056489050388336, 0.19629745185375214, 0.16241270303726196, 0.16038958728313446, 0.06757990270853043, 0.08785220235586166, 0.22376656532287598, 0.22879460453987122, 0.07035437971353531, 0.26509153842926025, 0.27334195375442505, 0.10105079412460327, 0.13249287009239197, 0.16713552176952362, 0.29184016585350037, 0.132020503282547, 0.3286565840244293, 0.24407337605953217, 0.3392776548862457, 0.10998272150754929, 0.2675303816795349, 0.24892035126686096, 0.07041420787572861, 0.20432230830192566, 0.22929981350898743, 0.26271164417266846, 0.059394653886556625, 0.23852548003196716, 0.10054049640893936, 0.06912466138601303, 0.17040225863456726, 0.10392114520072937, 0.20002442598342896, 0.0376339927315712, 0.0, 0.04920440539717674, 0.14896874129772186, 0.07234611362218857, 0.2535663843154907, 0.06088865175843239, 0.10011520981788635, 0.050953686237335205, 0.07824869453907013, 0.12424679100513458, 0.16098228096961975, 0.18998783826828003, 0.03609723225235939, 0.1886766403913498, 0.1447274535894394, 0.010578501038253307, 0.25892162322998047, 0.08244869112968445, 0.09646374732255936, 0.18765275180339813, 0.0, 0.06661231070756912, 0.018112659454345703, 0.01597684435546398, 0.07226342707872391, 0.012807841412723064, 0.007440141402184963, 0.027678916230797768, 0.0, 0.009630447253584862, 0.009334363974630833, 0.0, 0.0, 0.0, 0.006883211433887482, 0.009198649786412716, 0.0, 0.0, 0.003449296345934272, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.030920211225748062, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.012361020781099796, 0.0, 0.04995027184486389, 0.08800225704908371, 0.16166052222251892, 0.00885078776627779, 0.0, 0.0004950037109665573, 0.038524072617292404, 0.0, 0.0, 0.007897590287029743, 0.02671734429895878, 0.0, 0.0, 0.0, 0.0, 0.0, 0.007746663875877857, 0.14569416642189026, 0.0, 0.0, 0.0, 0.0, 0.01311169657856226, 0.0, 0.0, 0.01745450124144554, 0.0011769505217671394, 0.021978644654154778, 0.00442548468708992, 0.0, 0.13190284371376038, 0.0019200565293431282, 0.0, 0.007482187822461128, 0.0, 0.0, 0.10594192147254944, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0], [0.0, 0.03301367908716202, 0.0, 0.0, 0.001449841889552772, 0.03928075730800629, 0.03180352598428726, 0.0, 0.00820350181311369, 0.0, 0.0, 0.0, 0.005957278423011303, 0.0, 0.0, 0.0, 0.0, 0.0, 0.016405755653977394, 0.0, 0.0, 0.031826045364141464, 0.0, 0.008880265057086945, 0.0, 0.13598088920116425, 0.0, 0.0, 0.0, 0.0, 0.016846230253577232, 0.09310277551412582, 0.030670752748847008, 0.0, 0.036179348826408386, 0.0, 0.011377528309822083, 0.3109680116176605, 0.04349929094314575, 0.20507781207561493, 0.6286773085594177, 0.0, 0.09080257266759872, 0.02125856652855873, 0.06929932534694672, 0.2043980211019516, 0.21027794480323792, 0.2466120570898056, 0.28984689712524414, 0.113215371966362, 0.39217695593833923, 0.3168363869190216, 0.26559996604919434, 0.1484915018081665, 0.10509539395570755, 0.3347136080265045, 0.45016926527023315, 0.32514792680740356, 0.3399328887462616, 0.3226059079170227, 0.46514368057250977, 0.40817999839782715, 0.2626190483570099, 0.3537737727165222, 0.3132562041282654, 0.8219719529151917, 0.1102602407336235, 0.2805499732494354, 0.11649075150489807, 0.05380385369062424, 0.4001535475254059, 0.13067202270030975, 0.15978044271469116, 0.30835863947868347, 0.27409273386001587, 0.1019940972328186, 0.25039374828338623, 0.15604524314403534, 0.09749657660722733, 0.14989739656448364, 0.37734925746917725, 0.7551876306533813, 0.31909623742103577, 0.18029269576072693, 0.1308588683605194, 0.023227548226714134, 0.0, 0.006845544558018446, 0.0062438989989459515, 0.0, 0.0009419152629561722, 0.017259864136576653, 0.0, 0.0, 0.0, 0.0, 0.0, 0.057706281542778015, 0.0, 0.0, 0.0, 0.0, 0.0, 0.5760691165924072, 0.0, 0.0, 0.0, 0.12124385684728622, 0.0, 0.0, 0.0, 0.03166592866182327, 0.030426671728491783, 0.0, 0.0, 0.0, 0.014526726678013802, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.10052422434091568, 0.0, 0.0, 0.0, 0.14060406386852264, 0.056946296244859695, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.013340632431209087, 0.012719419784843922, 0.2394314706325531, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.033550214022397995, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.004442272242158651, 0.1496695727109909, 0.0, 0.07047732919454575, 0.2483345866203308, 0.0, 0.013537680730223656, 0.0, 0.0, 0.0, 0.1176535040140152, 0.06061259284615517, 0.0, 0.1500266194343567, 0.22638392448425293, 0.008146476000547409, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.028356226161122322, 0.2361341118812561, 0.003924965858459473, 0.015250748954713345, 0.08953768759965897, 0.10652028769254684, 0.0, 0.10331667214632034, 0.026835285127162933, 0.14224721491336823, 0.018060894683003426, 0.23745237290859222, 0.6967987418174744, 0.18442466855049133, 0.18555369973182678, 0.0031906655058264732, 0.16613520681858063, 0.33472955226898193, 0.16518810391426086, 0.19827334582805634, 0.3732794523239136, 0.29838207364082336, 0.2142723798751831, 0.7431502342224121, 0.2956491708755493, 0.06267974525690079, 0.25812938809394836, 0.2658372223377228, 0.269636332988739, 0.6880930662155151, 0.21974320709705353, 0.04208057373762131, 0.20741690695285797, 0.06236778572201729, 0.2392803430557251, 0.77986079454422, 0.3740397095680237, 0.3795088827610016, 0.2816706895828247, 0.13492487370967865, 0.24460715055465698, 0.22242654860019684, 0.27147963643074036, 0.06909981369972229, 0.09861196577548981, 0.3751753568649292, 0.1034470647573471, 0.3038043975830078, 0.7349128127098083, 0.4170476198196411, 0.29121553897857666, 0.2928614616394043, 0.5526101589202881, 0.2732524871826172, 0.13093256950378418, 0.3227417767047882, 0.8281673789024353, 0.28164809942245483, 0.06990567594766617, 0.33577337861061096, 0.3489009737968445, 0.20464837551116943, 0.04967809095978737, 0.28720685839653015, 0.26925554871559143, 0.07001098990440369, 0.0201138686388731, 0.0426923967897892, 0.03011482208967209, 0.16473723948001862, 0.12061788141727448, 0.17087309062480927, 0.01873668283224106, 0.09617682546377182, 0.054791536182165146, 0.1337278038263321, 0.2539892792701721, 0.20395535230636597, 0.0526043102145195, 0.13333986699581146, 0.31245386600494385, 0.09454631060361862, 0.056564636528491974, 0.09125262498855591, 0.02319650538265705, 0.05342203006148338, 0.041252605617046356, 0.05582674220204353, 0.04756522178649902, 0.20375990867614746, 0.005622423719614744, 0.08239578455686569, 0.0, 0.031233876943588257, 0.0, 0.014122442342340946, 0.009985788725316525, 0.05448755994439125, 0.03401673957705498, 0.13415147364139557, 0.0, 0.0, 0.3254786431789398, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.06978774070739746, 0.0131630664691329, 0.2353476732969284, 0.0, 0.0, 0.0, 0.01750989444553852, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.015371101908385754, 0.01109267957508564, 0.0, 0.0, 0.00740300165489316, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.007490475662052631, 0.0, 0.0, 0.0, 0.0, 0.004856986925005913, 0.017776647582650185, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.04721912369132042, 0.12765109539031982, 0.0, 0.0, 0.0, 0.0, 0.005291582550853491, 0.03078051283955574]]]})\n",
              "         }, function (err) {\n",
              "            console.log(err);\n",
              "        })"
            ],
            "text/plain": [
              "<IPython.core.display.Javascript object>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "7LQfXD3eOWxl"
      },
      "source": [
        ""
      ],
      "execution_count": null,
      "outputs": []
    }
  ]
}